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Preface 



The Third International Mathematies and Seienee Study (TIMSS), sponsored by the 
International Assoeiation for the Evaluation of Edueational Aehievement (lEA) and the gov- 
ernments of the partieipating eountries, is a eomparative study of edueation in mathematies and 
the seienees eondueted in approximately 50 edueational systems on six eontinents. The goal of 
TIMSS is to measure student aehievement in mathematies and seienee in partieipating eountries 
and to assess some of the eurrieular and elassroom faetors that are related to student learning in 
these subjeets. The study is intended to provide edueators and poliey makers with an unparal- 
leled and multidimensional perspeetive on mathematies and seienee eurrieula; their implemen- 
tation; the nature of student performanee in mathematies and seienee; and the soeial, eeonom- 
ie, and edueational eontext in whieh these oeeur. 

TIMSS foeuses on student learning and aehievement in mathematies and seienee at three 
different age levels, or populations. 

• Population 1 is defined as all students enrolled in the two adjaeent grades that eontain 
the largest proportion of 9-year-old students; 

• Population 2 is defined as all students enrolled in the two adjaeent grades that eontain 
the largest proportion of 13-year-old students; and 

• Population 3 is defined as all students in their final year of seeondary edueation, inelud- 
ing students in voeational edueation programs. 

In addition. Population 3 has two “speeialist” subpopulations: students taking advaneed eourses 
in mathematies (mathematies speeialists), and students taking advaneed eourses in physies 
(physies speeialists). 

Population 2 was the eore of TIMSS and sampling these students was required of all par- 
tieipating eountries. Partieipating in the various aspeets of TIMSS for Populations 1 and 3 
(ineluding the latter’s subpopulations) was optional but eaeh eountry was eneouraged to 
partieipate in all options. 




X MANY VISIONS, MANY AIMS 

The design of the study and its instrumentation are based on a eoneeptual framework that 
foeuses on the system, sehool, elassroom, and individual student levels. TIMSS was guided by 
the following questions: 

1 . What are students expeeted to learn? 

2. Who delivers the instruetion? 

3. How is instruetion organized? 

4. What have students learned? 

Eaeh aspeet of the TIMSS projeet — the eurrieulum analysis, the eontext questionnaire 
surveys, and the student assessments — was designed to address one or more of these four 
foeal questions. 

What are students expeeted to learn? 

The speeifieation of goals at the national or regional level, whieh lEA has traditionally 
termed the “intended eurrieulum,” defines what students are expeeted to learn. An analysis of 
seienee and mathematies textbooks and eurrieulum guides used in the partieipating eountries, 
along with a questionnaire administered to subjeet matter experts, provided data deseribing 
what students in the partieipating eountries are expeeted to learn aeeording to national or 
regional edueational goals. Results from a preliminary analysis of early eurrieulum data were 
used to ereate the TIMSS eurrieulum frameworks and to seleet the topies to be ineluded in the 
aehievement tests. The eurrieulum analysis, a portion of whieh is presented in this volume, will 
also provide invaluable information for interpreting the aehievement results. 

Who delivers the instruetion? How is instruction organized? 

Questionnaires were designed to address these questions as well as to provide information 
on the hypothesized eorrelates of aehievement and about the soeial and eeonomie eontexts in 
whieh learning is taking plaee. 

The partieipation questionnaire provided eontextual information about a eountry’s eduea- 
tional system. The first questionnaire dealt with the strueture of the sehool system, student ages 
and grades, and the sehool ealendar. The seeond questionnaire foeused on sehool systems and 
eurrieular/instruetional deeisions, teaehing qualifieations, and eourse struetures. 

In the TIMSS main survey, eontext questionnaires are administered to three separate 
groups: 

1 . The students sampled for TIMSS assessment; 

2. The mathematies and seienee teaehers of the seleeted students; and 

3. The prineipals of the sehools eontaining the seleeted students. 
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A student background questionnaire was administered to every student who participated in 
the achievement assessment. This provided information on student attitudes toward mathemat- 
ics and science, personal and academic background, school experience, and career/educational 
goals. A teacher questionnaire was administered to the teachers of Population 1 and 2 students 
only. It provided information on teachers’ academic and professional backgrounds, their 
instructional practices, pedagogical beliefs, and attitudes toward mathematics and science as 
well as their evaluation of their students’ curricular opportunities and their own curricular goals 
for students. Finally, a school questionnaire was completed by the appropriate school adminis- 
trator in each participating school. It provided data on school staffing and resources, textbook 
policy, curricular policy, and characteristics of the student body and the school’s community. 

What have students learned? 

Assessment of student achievement in key mathematics and science topics at each of the 
focal student populations entails both multiple-choice and open-response items (short answer 
and extended response). The tests were constructed from specifications reflecting TIMSS cur- 
riculum frameworks and include items developed and reviewed by international experts. At 
Populations 1 and 2, a subpopulation of sampled students participated in the performance 
assessment component of TIMSS. This consisted of a range of hands-on mathematics and sci- 
ence tasks. The tasks were set up in stations by assessment staff. Each station consisted of one 
or two tasks in mathematics, science, or a combination of both, with students attending three 
different stations with 30 minutes at each station to complete the designated activities. 

The present volume is the second report to come from the international curriculum analy- 
sis. The first volume considered the mathematics curriculum for students across the many 
countries participating in TIMSS. The current volume considers the sciences curriculum 
intended for students. More detailed volumes that look specifically at textbooks for mathe- 
matics and the sciences will also be produced. These curriculum volumes should prove to be 
an invaluable resource for understanding and interpreting the results of the student assessments. 

As is common with any research, there is a lag between the time data are collected and 
results are published. Most of the data presented represent what was available in countries in 
1990 and 1991 (with some data collected in 1992 and 1993). Some things have, no doubt, 
changed since then, and throughout the book the data are discussed with this in mind. 

Finally, the work reported here would not have been possible without the support of grants 
RED 9252935, SED 9054619, and RED 9550107 from the National Science Foundation (NSF) 
in conjunction with the National Center for Education Statistics (NCES). NSF and NCES pro- 
vided the funds for this resarch, but do not assume responsibility for the findings or their inter- 
pretations. 




I. Characterizing Curriculum: An Overview 




SCIENCE CURRICULA: INVESTIGATING CURRICULAR INTENTIONS 



3 



Chapter 1 

Science Curriculum: Investigating Curricular 
Intentions 

A 9-year-old girl sits in her classroom in South Africa looking through the win- 
dow — earlier this week her teacher conducted the class in building a bird 
feeder. The girl now observes birds visiting the feeder and records her observa- 
tions on a table that she has copied from her environment studies textbook. 

Earlier, a group of 13-year-old pupils in the Philippines followed the directions 
in their science and technology textbook for the construction of a model steam 
turbine. After completing this activity, they answered some questions on its 
operation in their textbook. In Spain, other 13-year-old students complete exer- 
cises in their textbook solving different chemical reaction equations for the time 
it takes for each reagent to disappear given the time it takes the new compound 
to form. After school, their teacher joins with several colleagues to prepare fur- 
ther materials for next week’s classes, sharing their ideas with each other and 
reading a set of detailed suggestions provided by the Ministry of Education to 
guide their teaching. In Germany, that evening, a teacher reviews her notes for 
the physics class she will teach the next day for students in their final year of sec- 
ondary school und compares them to the latest version of the official document 
guiding what she should present. Meanwhile, one of her students reviewed the 
notes he took during today ’s class describing the photoelectric effect, a topic he 
must master to do well on his Abiturl examination later this year. He compares 
his notes to the examples and problems in the textbook he purchased the previ- 
ous August. 

What do all these situations and others like them have in eommon? All involve ehildren. All 
involve the seienees. All involve eurrieulum materials that students or teaehers use in some 
way during seienee instruetion. Less obviously, all involve plans on the part of the teaeher and, 
at least indireetly, eurrieulum guides that help determine teaehers’ praetiees. Many faetors 
shape these strategies — experienees and personal beliefs about what is important in the sei- 
enees, views of how the seienees should be approaehed in the elassroom, offieial guidelines 
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Stating curricular goals, student textbooks, or some combination of these and other factors. 
These learning situations all flow from the visions and intentions inherent in that system’s sci- 
ence educational policies. 

How are all these situations different? Most obviously, they differ in the sciences studied. 
Even when dealing with the same topic, they use different activities and materials to approach 
and explore the topic with children. They differ in what was covered previously and in what 
students are expected to master at that time. They vary in how long lesions on that topic will 
continue, and in many other ways. The situations differ in how much class time is spent on a 
given subject, and how that time is spent. How free teachers are to put their personal stamp on 
individual lessons also varies. The use of science textbooks, if any, varies. Preparation differs 
in how explicitly official documents direct teachers in providing instruction. The situations dif- 
fer in the experiences science curriculum planners intended that children share. They also vary 
in how they will be judged — in how the system will determine whether teachers and students 
successfully attained intended goals. 

Across the world, teachers and their students engage in the study of the sciences as they 
have for generations. It is widely believed that science is objective and universal, transcending 
national and cultural differences. But what students and teachers experience is not actual sci- 
entific investigation but school science. School science is science as it is conceptualized, rep- 
resented, structured, and sequenced to share with the next generation through the common 
experiences of schooling. Like all of education — which is a common means of transmitting a 
nation’s culture to its next generation — school science is profoundly cultural. This monograph 
aims to explore this cultural aspect of science education by attempting, through an investiga- 
tion of curricula, to identify differences and similarities that underlay the curricula of school sci- 
ence of many countries. 

Why Investigate Science Curricula? 

Each day in classrooms around the world, children and their teachers engage in some aspect 
of learning science. These daily educational experiences, which seem so very ordinary, are 
actually guiding and shaping children’s lives. The cumulative effect of the experiences pupils 
share help mold them and help determine the eourse and quality of their lives. Any set of sci- 
ence educational experiences will have some things in common (and many things that vary) 
among countries. Some differences are deep; some are incidental. Separating the two is essen- 
tial to understanding better how children are educated in science. It is essential for seeking — 
within given cultural settings — more effective educational practices in schools, classrooms, 
and textbooks. Curriculum is the most fundamental structure for these experiences. It is a kind 
of underlying skeleton that gives characteristic shape and direction to science instruction in 
educational systems around the world. 

These experiences do not occur randomly or accidentally. Instead, they are deliberately 
shaped based on visions of what education should be, ideas of how to create the formative expe- 
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riences of education, and intended patterns of opportunities that organize the potential for those 
experiences. The myriad details of classroom life often hide the fact that instructional activi- 
ties are intended to be planned and orderly implementations of the aims and intentions of edu- 
cational authorities and curriculum designers. The plan that expresses these aims and inten- 
tions, that takes them from vision to implementation, that serves as the broad course that runs 
throughout formal schooling, is curriculum. Curriculum provides a basic outline of planned 
and sequenced educational opportunities. It is “the idea of structure imposed by authority for 
the purpose of bringing order to the conduct of schooling.”^ 

The status and future of any nation are caught up in its children’s lives and their education. 
No nation can thrive for long if it seriously fails to educate its children. Thus, no nation can 
afford to ignore curriculum — for the sciences or any other important subjects. Curriculum 
must be understood, valued, and deliberately guided. In forming educational policy, educa- 
tional systems help shape the future of their children and their country. 

In recognition of the central importance of curriculum in education, the Third International 
Mathematics and Science Study (TIMSS) includes large-scale cross-national analyses of sci- 
ence curricula as part of its examination of science education and its attainment in almost 50 
nations. The TIMSS curriculum analysis investigates curriculum documents and the visions 
and aims on which they are based. 



Earlier Studies 

Researchers have long been interested in curricular intentions, yet few have examined them 
and their relationships to national strategies for covering science topics. The little work that has 
been done points to the potential of future studies in this area for helping understand why 
science students’ achievements and teachers’ instructional methods differ among countries. 

• For example, one study of national curriculum guides from a large multi-country sam- 
ple revealed important regional differences in emphasis given to science instruction in 
primary and secondary school curricula.^ This study found that countries in Eastern 
Europe and Eatin America devoted significantly more time to the study of the sciences 
than did countries in the rest of the world. 

• Some studies of European curricula have revealed considerable variation between coun- 
tries in the degree to which physics is taught with a consideration of the interactions of 
applied physics and society.'* 

• Significant cross-national variation has also been noted in whether the scientific disci- 
plines are taught as collections of concepts and facts or whether there is more emphasis 
on practical activities.^ 

• Even between textbooks series in the same country, there appear to be many significant 
differences when examined in detail. Such differences have been reported, for 
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example, in the development and presentation of important eoneepts that lead to an 
understanding ofbiologieal evolution/ 

The intriguing differenees aeross eountries suggested by these studies have elear impliea- 
tions for understanding how seienee eurrieula shape elassroom aetivities and determine what 
skills students are likely to aequire. These studies illustrate some of the potential in investigat- 
ing eurrieular doeuments. 

The present eurrieulum analysis is a natural extension of the informal analyses of eurrieu- 
lum guides and textbooks found in earlier studies of the International Assoeiation for the 
Evaluation of Edueational Aehievement (lEA). In lEA’s Seeond International Seienee Study, 
for example, researehers were asked to rate various seienee eontent areas aeeording to whether 
or not (and the extent to whieh) they were eovered in the eurrieulum of their eountry. Many 
partieipants assigned these ratings by eonsulting eurrieulum guides and textbooks/ This 
TIMSS study builds upon that idea but has developed more thorough, rigorous, data-gathering 
methods to doeument what eountries intend to teaeh. 

Curriculum and Student Experience 

For about a century, curriculum has been understood in terms of student experiences in 
school. For example, Bobbitt (1918)* considered curriculum to be “the entire range of experi- 
ences, both directed and undirected, concerned in unfolding the abilities of the individual.” He 
also called curriculum the "series of things which children ... must do and experience by way 
of developing abilities to do the things well that make up the affairs of adult life” (emphasis in 
original). Before Bobbit, John Dewey ® had pointed out that the curriculum is the reflective for- 
mulation of experience, helping to guide an orderly succession of experiences for pupils in 
school. In this sense, science curricula are those experiences needed to develop students’ sci- 
ence abilities. 

Students’ classroom experiences are created by the interaction of assigned tasks, activities 
to accomplish those tasks, materials supporting the activities, students, and teachers. Each 
such interaction creates an experience for each student. Each experience is personal and idio- 
syncratic for each student. It is these individual experiences that are the basics of schooling and 
curricular experience. The variety and accumulation of these experiences for a student produce 
his or her educational attainments. Curriculum and teaching consistently reflect the desire to 
create sequences of common, shared experiences that result in desired attainments for as many 
students as possible. 

Differences in children’s curricular experiences produce individual and characteristic 
national outcomes in science learning. In this sense, experiences reflect educational intention 
and planning. These experiences, however, are also personal. Besides being the result of inter- 
actions with external factors — such as tasks, materials, and activities — they also involve 
internal factors — including each student’s perceptions, interests, and motivations surrounding 
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the phenomena experienced, involvement with the setting, and the culture and traditions that 
help shape those perceptions. While these sets of experiences and their cumulative effect are 
the objects of curricular intentions and planning, they can, since they are personal and individ- 
ual, only be influenced partially and indirectly. Thus, curricular intentions can at best only 
determine potential student experiences — experiences intended to be common for large num- 
bers of students and to be causally linked to desired attainments. 

Curricula create and distribute educational opportunities in an effort to create desired com- 
mon experiences. The characteristics of any particular science curriculum are thus captured in 
part by documenting aspects of the opportunities it creates. For further discussion of this view 
of curriculum, see appendix A; for information on a general model of potential experiences, see 
appendix B. 



An Approach to Curriculum Analysis 

The TIMSS curriculum analysis effort set out to understand the intentions, that is, the 
visions and aims, helping shape science curricula in some 50 nations. But how can curricular 
visions and their associated curricula be analyzed? In smaller scale projects, the “artifacts” of 
curricular visions are commonly used — curriculum guides,” textbooks, tests, and materials. 
Although these data provide only a partial glimpse of the curricular vision behind the everyday 
realities of educational life, they do allow certain inferences to be made about curricular inten- 
tions. 

Before TIMSS, curricular documents had never been used as the primary data source for a 
project of this scale. Resource limitations caused previous large-scale curriculum studies to 
rely almost solely on expert opinions rather than curricular documents. While TIMSS also suf- 
fered from resource limitations — for example, it was not possible to translate all documents 
into a single common language — methodologies, described in the next section, were devel- 
oped to enable the study to investigate curricular intention through careful document analysis 
supplemented by expert opinion. 

Ideally, a full study of curricular documents would include ministerial policy documents, 
curriculum guidelines, course syllabi, textbooks, syllabi for national examinations, teacher ped- 
agogical plans as they interpret broader requirements, tests, and so on. We limited our atten- 
tion, however, to those central documents common to virtually all the participating countries - 
science curriculum guides and student textbooks. 

• The curriculum guides are official documents that most clearly reflect the intentions, 
visions, and aims of curriculum makers. 

• Textbooks provide less official, partial reflections of intentions as interpreted by other 
participants in the curriculum process. In many countries, textbooks capture important 
insights about intentions and aims. 
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Some expert opinion data supplement analyses of these doeuments. Supplemental materi- 
als and annotated teaeher editions of textbooks would have offered additional data, but, beeause 
they were less eonsistently used, we did not inelude them in this study. 

Analytic Methods 

The TIMSS Science Framework 

The first methodologieal requirement was to develop a tool for segmenting and eategoriz- 
ing pieees of the eurrieular doeuments and TIMSS tests. To this end, a unified set of eategories 
was developed: the TIMSS seienee framework. The framework foeuses on three aspeets of 
seienee edueation and testing: 

• Content refers simply to the seienee topie area. 

• Performance expectation refers to eommon aspeets of students’ eompleting seienee 
tasks. This aspeet speeifies what the student is to do with the seienee eontent. 
Expeetations were eonsidered less eulturally determined than postulating the eognitive 
proeesses of performing speeifie seienee tasks. 

• Perspective refers to broad themes that might underlie many tasks, for example, empha- 
sizing the soeietal importanee of the seienees through speeifie eontents or tasks. 

Appendix C diseusses the seienee framework in some detail and lists the eategories of the 
framework’s three aspeets. Note that throughout this monograph, we use single quotation 
marks to indieate verbatim framework eategory labels: thus, ‘bioehemistry of geneties’ is a eat- 
egory label. Informal topie areas and referenees to topies that are part but not all of a formal 
eategory are not enelosed in quotation marks. 

Topic TraccMapping 

Some eurrieular information is essential for all grade levels. It was deeided to obtain these 
data for all eontent topies in the seienee framework. Unfortunately, this was feasible only by 
using expert opinions rather than direetly by doeument-based methods (exeept for a few seienee 
topies eovered in depth). 

Eaeh eountry was asked to designate a panel of experts that would provide information on 
eaeh grade in whieh eaeh topie was eovered. The experts were asked to base their responses on 
eurrieulum guides and other eurrieular materials, but the ways in whieh this task was done were 
not direetly monitored. 

For eaeh topie, the experts were asked to provide two kinds of information. First, they were 
to indieate all grades in whieh aspeets of that topie were eovered. Seeond, they were asked to 
indieate in whieh grade the topie was the “foeus” of more extensive or intensive eurrieular 
attention. Experts provided similar data for all the different major regions or streams in their 
eountry with differing seienee eurrieula. These eoverage and foeus data were eolleeted for 
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science content topics only; pilot work showed that this method did not provide reliable data on 
performance expectations or perspectives. 

The result of this collection effort was a “trace” or “map” of the way in which each content 
topic entered and left the science curriculum across years of schooling. Any special focus or 
curricular attention was also mapped. To ensure reliability, countries were asked to provide 
their data more than once, asked to review the data they had provided, and asked direct ques- 
tions about any apparent discrepancies. A more document-based method was used to gather 
fuller, in-depth information on a small, central set of topics; this technique was called “in-depth 
topic trace mapping.” Those data are not reported in this monograph. See appendix D for a 
more detailed discussion of topic trace mapping. 



Document Analysis 

To specify science curricular intentions completely for any country would have required 
collecting information from every document — every curriculum guide and every textbook — 
for every science course at each grade and for each educational track or stream in the country. 
Such a vast amount of data collection was neither practical nor economically feasible in a sin- 
gle country, let alone in the almost 50 TIMSS countries. Instead, we decided to sample the doc- 
uments. 

To develop a practical sampling scheme and methodology, researchers had to balance sev- 
eral important, conflicting demands: 

• The need for some information on intentions at all grade levels; 

• The need for detailed information at some grade levels, particularly at the focal grades 
at which achievement testing would occur; and 

• The need to be sensitive to (1) important national differences in educational governance 
and textbook role and (2) curricula and textbook differences within countries. 

The grades selected for document collection were those for which TIMSS achievement test- 
ing would take place: in each country, the two consecutive grades with the majority of 9-year- 
olds (hereafter called TIMSS Population 1), the two grades with the majority of 13-year-olds 
(Population 2), and the physics specialist courses in the final year of secondary school 
(Population 3). Documents were sampled rather than surveyed exhaustively. 

Each national document sample required selecting curriculum guides and textbooks to rep- 
resent those used for at least half of the students in the targeted grades. Major regional, school 
type, and other strata were to be represented appropriately in the sample. National curriculum 
guides were sampled if they existed; otherwise, the sample consisted of appropriate regional, 
provincial, etc., guides for each grade. Similarly, official national textbooks were sampled if 
they existed; otherwise, the most widely used commercial textbooks were selected. The 
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documents included for each country were chosen by country representatives in consultation 
with TIMSS. Documents were marked for analysis in each country and coded (without trans- 
lations) for the three aspects of the TIMSS science framework in the individual countries. Next, 
informational questionnaires in English were provided, and marked archival copies of the doc- 
uments were sent to the curriculum analysis center for filing and reference. 

Forty-eight countries reported at least some document-based curriculum data. These 
included 77 science curriculum guides for the upper grade of Population 1, 111 for the upper 
grade of Population 2, and 63 for the physics specialists of Population 3. The textbook sample 
comprised 96 science textbooks for the upper grade of Population 1, 156 for the upper grade of 
Population 2, and 60 for the physics specialists of Population 3. Thus, the analysis is based on 
a sample of 251 science curriculum guides and 312 textbooks, a total of 563 curriculum docu- 
ments. 

The documents were written in more than 30 different languages. Even for the sample, it 
was not feasible to translate complete documents. Instead, procedures were developed and 
shared that allowed each country to use its own team to mark and code important features of 
each document. The features chosen are discussed below. They certainly did not exhaust all 
aspects of the documents, but they did represent features that pilot work and early field trials 
suggested were important for capturing document intent, structure, and some essential content. 

Many documents were quite long, so dividing them into smaller segments was essential. 
This was done in two stages. First, each document was separated into a series of units to cap- 
ture major structures. Units were of several types, and each unit had its type determined and 
recorded by the appropriate country team. To capture even more finely grained structures in the 
documents and to attach framework codes to small, narrowly defined segments, each unit was 
further subdivided into one or more segments called blocks. For a listing and detailed descrip- 
tion of the unit and block types coded, see appendix E. 

Next, category codes for science content, performance expectations, and perspectives were 
assigned to blocks. These data — a “statistical abstracf ’ of each document — were recorded 
on appropriate forms and cross-referenced to marked and numbered segments of the original 
documents. The marked documents, coding forms, and supplemental questionnaires for each 
document, unit, and block were sent to the curriculum analysis center for data entry and archiv- 
ing. 

These methods involved considerable decision making by each country’s document analy- 
sis team. Several measures were taken to ensure uniformity and reliability. Detailed manuals 
were prepared for every procedure. Face-to-face training was provided to representatives of 
every country through a series of regional training sessions lasting almost 3 days each; for this 
training, a manual, examples, and exercises were prepared. An initial quality assurance phase 
required national teams to code a selected random sample of units, which were then translated 
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and coded by international referees; failures to meet satisfactory criteria were noted and ana- 
lyzed. Only when the criteria had been met (by further practice, training, coding new samples, 
etc.) were countries authorized to begin the main analysis. All received materials were care- 
fully examined, and discrepancies between documents and forms were pursued individually to 
obtain clarifications. Finally, after the collection was complete, a further sample of submitted 
materials was selected, translated, and coded for each country. An appropriate reliability esti- 
mating procedure was developed and applied. In virtually every case, concordance of more 
than 80 percent (and often more than 90 percent) resulted. For more detail and examples of 
document analysis, see appendix E. 
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Note that we focus here only on students’ experiences occurring through and created by the 
deliberate efforts of schooling, since our goal is to investigate curriculum as intentional and 
planned. 

" “Curriculum guide” is used here as a generic, standardized term for countries’ official doc- 
uments setting out policies and curricular intentions. Curriculum guides provide an official 
statement of what a science curriculum is intended to be in a specific context. 
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Chapter 2 

Overview of Results 

This monograph presents the major findings of a large-seale investigation of the seienee eur- 
rieular visions and aims of the almost 50 eountries partieipating in the Third International 
Mathematies and Seienee Study (TIMSS). For the first time ever in a study of this seope, 
national eurrieular doeuments — speeifieally, offieial eurrieulum guides and textbooks — were 
the primary data souree; they were supplemented with expert opinion. The analyses deseribed 
in ehapters 3 through 9 of this monograph are the first attempts to eompare and eontrast similar- 
ities and differenees in seienee eurrieular intentions aeross the TIMSS eountries. Mueh more 
work remains to be done with these data, and we suggest future researeh direetions in ehapter 10. 

Monograph Organization 

Given the seope of this investigation, the findings are organized for use by the edueational 
poliey makers, seienee edueation poliey makers, seienee eurrieulum developers, teaehers, and 
other professionals interested in effeetive seienee eurrieula who are the readers of this mono- 
graph. The monograph is organized into five major seetions. 

• Characterizing Curricula: An Overview. This section highlights the study’s most 
important findings and caveats. Readers interested in a general introduction to and 
overview of the TIMSS curriculum analysis effort should read chapters 1 and 2. 

• Curricular Organization and Control. The two chapters in this section — 3 and 4 — 
address general topics in comparing educational systems, their control, and related pol- 
icy issues. 

• Reflections of Curriculum. This section comprises chapters 5 through 9; it covers spe- 
cific issues of science curricula and related policy. In general, chapters 5 through 8 look 
at broad similarities and differences in science content, performance expectations, and 
perspectives across the TIMSS countries. Chapter 9 presents a different focus on the 
data: here, the search is across smaller groupings of countries seeking common patterns 
in curricular intentions. 
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• Consequences of Curriculum: Policy Implications. This section looks at the impli- 
cations of the curriculum analysis findings. Chapter 10 summarizes broad findings and 
points out directions for future studies. 

• Supporting Data. The several appendices to this monograph present more detailed ver- 
sions of data and information appearing in the main text. Specifically, the first five 
appendices (appendices A through E) focus on key models and methods underlying the 
investigation. Appendices F through H list the various resources on which this work 
relied. Appendix I contains comprehensive data tables and figures. 

Monograph Conventions 

We have relied on several conventions in presenting the information in this monograph, 
specifically: 

• Sampling in Graphic Displays. Throughout the monograph, tables and figures contain 
representative, illustrative results rather than complete data (which, for most tables, are 
included in appendix I). In some displays, specific countries, topics, or grade levels were 
selected, either according to particular criteria or to provide a typical picture. When par- 
ticular criteria are involved, it is stated so in the discussion. Otherwise, countries and 
topics were selected to provide a representative illustration of the patterns and variations 
in the data. Some effort was made to rotate the selection of representative countries so 
that each TIMSS country appears in at least some of the figures and tables. Unless 
specifically noted, nothing else should be read into the selection of particular countries 
or topics. 

• TIMSS Focus Populations. TIMSS is designed to gather information about mathe- 
matics and science learning and achievement for three different student populations. 
Student Population 1 is defined as all those enrolled in the two adjacent grades that con- 
tain the largest proportion of 9-year-old students. Population 2 is defined as all students 
enrolled in the two adjacent grades that contain the largest proportion of 13 -year-old stu- 
dents. Population 3 is defined as all students in their final year of secondary education. 
This definition includes two subgroups: “generalists,” which includes all students 
including those in vocational programs, and “specialists,” which includes those students 
taking advanced courses in physics (physics specialists). The focus in the curriculum 
analysis and the student assessment aspects of TIMSS has been upon those students in 
the upper grade of student Populations 1 and 2. For example, in a country in which most 
9 year-olds were in grades 3 and 4, the TIMSS focus would be on students in grade 4. 

• TIMSS Framework Topics. We have relied on the science framework developed by 
many persons, presented in several reports, and finally published in Robitaille et al. 
(1993) and summarized here in appendix C, in coding and describing curricular content, 
performance expectations, and perspectives. Where a verbatim curriculum framework 
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topic label is used in this monograph, we have indicated it with single quotation marks 
(e.g., ‘biochemistry of genetics’); informal topic areas and references to topics that are 
part but not all of a formal category are not enclosed in quotation marks. 



Study Findings 

Similarities Within a Context of Differences (See Chapter 3) 

National and subnational education systems differed in several important ways. They dif- 
fered in broad system features such as school entry age, the number of years of schooling pro- 
vided, and the number of years of schooling that were compulsory. They also differed in how 
school grades were clustered — that is, in the grade levels at which breaks between elementary 
sehool, lower seeondary sehool, and seeondary sehool oeeurred. These differenees affeeted the 
eontext of sehooling, the resourees available, and other aspeets of the learning environment. 

Edueational systems also differed in their eurrieular organization. Even within broadly 
similar systems, there was eonsiderable differentiation into various streams within sehooling 
and various seienee eurrieula intended to serve different student eohorts. This elearly implies 
differenees in the kinds of learning opportunities provided, in the seienee eontents involved, in 
the typieal expeetations for students, and in the organizing and sequeneing of the opportunities 
provided. The systems also differed with regard to how eurrieular deeision making was dis- 
tributed within the edueational system — among ministries, sehools, teaehers, and so on. 
Whieh deeisions were made by whom varied both among eountries and among various nation- 
al subsystems within many eountries. Nations also differed in the eomplexity of their national 
systems. Some were relatively homogeneous, with essentially one eentralized national system; 
others were more heterogeneous, with many subsystems and eurrieular and organizational dif- 
ferentiation even within these subsystems. For example, the United States is a “federalism” of 
more than 50 edueational systems. 

Any similarities among seienee eurrieula and edueation had to be sought within this eontext 
of differenees among edueational systems. Broad similarities in seienee edueation were not 
hard to find. All eountries required seienee study for at least some grades. Of the topies in the 
TIMSS seienee framework, about 30 to 40 were introdueed in every eountry at some point with- 
in sehooling. All eountries reported some interest in seienee edueation reform of one sort or 
another. 

When analyses were made more speeifie, the patterns of national and subnational differ- 
enees in seienee edueation persisted. The numbers of eourses offered at various points in any 
stream of sehooling — and the organization of those eourses — varied. Currieulum guides, the 
offieial doeuments that set out seienee eurrieula, varied in their status, strueture, size, speeifiei- 
ty, and use. Textbooks also varied in their status, strueture, size, and use. 
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Curriculum guides and textbooks from the participating countries also differed in the 
emphasis they placed on and the space they gave to various broad science topics. They dif- 
fered in terms of what students were expected to be able to do with those topics. The sequences 
of content presentation varied among the textbooks; this was true both among countries and 
within some countries in which more than one text per grade level was used. 

Differences among countries were hardly surprising, although their extent and the detailed 
level at which they persisted might surprise some researchers. Also, some broad similarities 
aeross eountries were antieipated. However, what stands out in this initial survey is that the 
similarities in seienee eurrieula were found in a eontext of wide, detailed, and persistent differ- 
enees and variations both among and within eountries. 

This is not to suggest that an empirieal seareh for substantive similarities in intentions for 
seienee eurrieula would be fruitless. Rather, it emphasizes the eare needed in sueh a seareh and 
reinforees the idea that, overall, any eross-national eomparisons of seienee eurrieula require 
eareful interpretation and eontextualization when drawing inferenees. 

The Role of Science Curriculum Guides (See Chapter 4) 

Seienee eurrieulum guides differed in their status, authority, and funetion among TIMSS 
eountries. While always setting out offieial goals and aims for seienee eurrieula, eurrieulum 
guides in some eountries elearly had the foree of binding doeuments strongly guiding eurrieu- 
lar implementation in instruetion. In other eountries, however, they seemed to have been taken 
more as suggestions — artieulating goals and emphases, and direeting ehoiees in whieh text- 
book materials were used among those available. In the latter eases, individual teaehers, groups 
of teaehers, sehools, and groups of sehools had eonsiderable deeision-making authority regard- 
ing eontent emphases and instruetional materials. Further, textbooks in those eountries served 
at times almost as de faeto seienee eurrieula, with eurrieulum guides helping to shape omis- 
sions, time alloeations, and instruetional goals. 

Currieulum guides differed in their names (“frameworks,” “syllabi,” and “eourses of study” 
were some common alternatives). They differed in their level of inelusiveness — that is, in the 
number of grades and ages to whieh any one doeument was relevant. These differenees 
oeeurred both among eountries and within some eountries. 

Currieulum guides also differed in their balanee between more preseriptive approaehes (for 
example, use of poliey statements, objeetives, and eontent speeifieations) and more faeilitative 
approaehes (sueh as pedagogieal suggestions, examples, and assessment suggestions). Almost 
all eurrieulum guides used a eombination of these approaehes. They differed, however, in the 
relative use of preseriptive versus faeilitative approaehes; few eountries evenly divided their use 
of these approaehes. 

Seienee eontent was speeified in almost every part of most of these doeuments and for every 
eountry. Overwhelmingly, the eontent was indieated as presented at the most speeifie level 
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made possible by the TIMSS seienee framework. Student performanee expeetations were 
somewhat less pervasive and less speeifie. These expeetations were indieated by national 
eoders as present in most seetions of most eurrieulum guides but not in all. Often, these expee- 
tations were not marked at the most speeifie level available; this suggests more general state- 
ments of expeetations in the doeuments, a mismateh between the possibilities in the framework 
and those needed to eharaeterize the doeument, or both. 

Although similarities were again in a eontext of differenees, seienee eurrieulum guides 
overall seemed to funetion eonsistently to define and eommunieate eurrieular intentions and 
goals, to do so in a variety of ways, and to be speeifie about the seienee eontents involved (per- 
sistently) and about what was expeeted of students (often). Certainly, these doeuments served 
in at least some eountries as an important means of eontrolling and guiding eurrieular imple- 
mentations in seienee instruetion. 

The Flow of Science Curricula (See Chapter 5) 

Seienee eurrieula are implemented aeross the years of sehooling. In that sense, any one eur- 
rieulum has a “flow” aeross grades: Topies are introdueed, eontinue for a time, and eease to 
reeeive attention. There were eonsiderable national variations in flow. Primarily, the same 
topie was introdueed at different times in different eountries, and the eoverage of a topie eon- 
tinued for different numbers of grades in different eountries. Even so, it was possible to iden- 
tify sets of topies that were eharaeteristie — but not universally applieable — of groups of adja- 
eent grades in many eountries: 

• The seienee eurrieulum in grades 1 through 3 was primarily devoted to taxonomy in the 
life and earth seienees. ‘Weather and elimate’ was also eommon. 

• In grades 4 through 6, life and earth seienee topies were extended and additional physies 
topies were eommonly introdueed. ‘Pollution’ and resouree eonservation eoneepts were 
introdueed for the first time. 

• In grades 7 and 8, many more physies and ehemistry topies were introdueed. 

• Grades 9 and beyond, eommonly saw the introduetion of more advaneed topies in genet- 
ies, physies, and ehemistry. 

Similar eommonalities and differenees oeeurred with regard to how long topies eontinued 
to be eovered and when their eoverage was eompleted. Countries differed in the number of top- 
ies intended for instruetion in eaeh grade, in how often and when new topies were introdueed, 
and in how often and when old topies were dropped from eontinued eurrieular attention. 
Consequently, some eountries had more foeused eurrieula with attention restrieted to a rela- 
tively small number of topies; others had eomparatively more diverse eurrieula. Some eoun- 
tries had sehool seienee that was eontinually ehanging — new topies added, old topies dropped 
— while other eountries made eomparatively fewer ehanges. 
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The data on the flow of seienee eurrieula aeross the grades painted a rieh pieture of nation- 
al differenees but with surprising eommonalities in the sequenees of eontent eoverage and in 
the plaees in whieh topies were in the eurrieular flow of many eountries. These data represent 
important eontextual information for interpreting seienee attainments. 

Milestones in Science Curricula (See Chapter 6) 

Seienee eurrieula do not flow aeross the grades as even, undifferentiated sequenees. Eaeh 
eurrieulum has eertain milestones — key topies that are the foeus of speeial eurrieular attention 
— seattered throughout their sequenee. Countries supplied data indieating at whieh grades eer- 
tain topies were the foeus of speeial eurrieular attention. As always, there were many differ- 
enees among eountries and among seienee topies. Also, while data on eommonly eovered top- 
ies aeross grades show that many topies reeeived eurrieular attention from many eountries, data 
on foeus topies show that far fewer topies reeeived sueh attention from many eountries. In faet, 
no topie at any grade level was indieated as a foeus in the same grade for more than 70 pereent 
of the eountries. Sueh laek of common focus and marked cross-national diversity in curricular 
attention make science attainment testing difficult and require that the results of such testing be 
carefully interpreted. 

In identifying milestone contents at key grades — the upper of the two grades for 
Population 1 (those containing the most 9-year-olds), the upper of the two for Population 2 
(those containing the most 13-year-olds), and the physics specialist subpopulation of Population 
3 (final year of secondary school) — data from the analysis of curriculum guides and textbooks 
can be used to identify common milestones. A portrait of commonly intended topics at these 
key grade levels (those present in the curriculum guides of 70 percent of the countries, the text- 
books of 70 percent of the countries, or both) emerged: 

• The upper grade of Population 1 was generally focused on taxonomy in earth and life 
science. In addition, some elements of physical and earth sciences were present. 

• The upper grade of Population 2 showed great diversity, with topics from many areas in 
the science framework present. 

• The physics specialists of Population 3 were usually exposed to a curriculum devoted to 
19th century physics. 

With these data, it was possible to compare what was commonly intended in curriculum 
guides with what was commonly intended in textbooks. Often, the same topics were widely 
present in both. Some topics — usually more advanced topics or those related to recent reforms 
in school science — were present in curriculum guides but not in textbooks. This suggested 
that more conservative approaches were taken in textbooks, or that there was a lag between 
when topics began to be emphasized and when they found their way into textbooks. 
Conversely, some topics — usually those already considered in previous grades — persisted in 
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textbooks even when not widely present in eurrieulum guides. This further suggests more eon- 
servative visions of seienee eurrieula implieit in textbooks. 

Topies widely present in both eurrieulum guides and textbooks (in 70 pereent of the eoun- 
tries) and also emphasized in textbooks (indieated for at least 6 pereent of the bloeks in text- 
books eovering the topie, a eutoff empirieally determined to indieate signifieantly more text- 
book emphasis for a topie) were identified. Very few topies were widely present and empha- 
sized in this way. 

• In the upper grade of Population 1, only two topies — ‘plant, fungi types’ and ‘animal 
types’ — were thus emphasized, but these two together aeeounted for only about a quar- 
ter of that population’s textbook bloeks. 

• Only one topie was emphasized in this way at the upper grade of Population 2 — 
‘organs, tissues.’ Far fewer of the textbook bloeks (under 10 pereent) were aeeounted 
for by this topie. 

• For the Population 3 physies speeialists, six topies were emphasized: ‘energy types, 
sourees, eonversions,’ ‘wave phenomena,’ ‘light,’ ‘eleetrieity’, ‘magnetism,’ and ‘time, 
spaee, motion.’ ‘Eleetrieity’ aeeounted for about 20 pereent of these speeialist textbooks 
and ‘magnetism’ and ‘light’ together aeeounted for about another 20 pereent. 

When textbooks alone were eonsidered, it was apparent that a few eentral topies did not 
dominate upper grades of Population 1 and 2 — emphasized topies took up only 25 pereent of 
textbooks in Population 1 and less than 10 pereent in Population 2. On the other hand, text- 
books for the Population 3 physies speeialists used about 70 pereent of their spaee to eover six 
emphasized topies. 

Combining sequenee data on the flow of seienee eurrieula — the grades at whieh topies 
were typieally eovered — with doeument-based data on the eommonly intended topies at the 
three key grades revealed a pieture of eonsiderable eross-national diversity. This again suggests 
eaution in interpreting seienee attainment results. 

There were surprising eommonalities aeross eountries in terms of the topies widely intend- 
ed at key grades and those that dominated the relevant textbooks. A wider look at foeus data 
for all the grades, however, revealed eonsiderably more diversity. 

Emphases in Science Curricula (See Chapter 7) 

Seienee topies are not likely to reeeive the same amount or kind of eurrieular attention 
aeross their total eoverage in a eountry’s eurrieulum. For some topies, work will go on longer 
than for others; others will be the subjeet of intense work for various periods of time. Thus, 
eertain topies will reeeive more intense eurrieular attention and emphasis than others over time. 
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Varied methods were used to assess such intense curricular attention based on curriculum data 
and documents. 

One criterion for curricular attention or emphasis was the presence of topics in both cur- 
riculum guides and textbooks at key grades. Many topics received relatively high levels of cur- 
ricular attention in this sense. For example, ‘plant, fungi types’ and ‘animal types’ were present 
in both the curriculum guide and textbooks for the upper grade of Population 1 in many coun- 
tries. Other emphases were identified in this way. 

An alternative criterion for emphasis or intense curricular attention is whether a topic was 
one of many covered in the same grade. It cannot be assumed that multiple topics covered in 
the same grade within a country received equal amounts of curricular attention. However, we 
can assume that covering several topics in some way limits the curricular attention devoted to 
each. Thus, somewhat less attention was paid to a topic when it was one of many covered at a 
grade than would be the case if it were one of only a few topics. In this sense, data presented 
in chapter 5 on how many topics were covered in each grade in each country give some indi- 
cation of the emphasis or intensity of curricular attention they received. Some countries were 
seen to have given comparatively more intense curricular attention to a few topics, while oth- 
ers had a more diverse — and presumably less intensely focused — science curriculum. 

The curriculum coverage and focus data were also used to construct numerical indicators 
of curricular attention for each grade and cumulative curricular attention across all the grades 
within each country. This method revealed a pattern of marked cross-national variation. 
Many countries showed little or no comparative emphases on particular topics. The few top- 
ics that did receive some emphasis were the same previously identified as emphasized and 
widely covered. 

A more fine-grained approach involving percentages of textbook blocks was used to assess 
the relative emphasis of all topics and to assess cross-national differences in such emphases. 
The pattern that emerged clearly emphasized the commonly intended topics identified in chap- 
ter 6; even among those commonly intended topics, however, there was substantial cross- 
national variation. Other topics emphasized in some, but not all, countries were also identified. 

This material provides a more detailed context for previously presented data on focus top- 
ics and emphasized, commonly intended topics. Certainly, the degree of curricular attention 
suggested by those designations was borne out by the analyses of this chapter. Further, how- 
ever, the nature of cross-national variations in curricular attention among topics and grades was 
made clearer. This served to make the few central topics stand out even more. 

Performance Expectations and Disciplinary Perspectives (See Chapter 8) 

The sampled science curriculum guides and textbooks revealed widely held commonalities 
in what students were expected to do with the science contents specified. 




OVERVIEW OF RESULTS 



21 



• At the upper grade of Population 1, eommon intentions involved ‘understanding eom- 
plex information,’ ‘using apparatus, equipment, eomputers,’ ‘doing routine experimen- 
tal operations,’ and ‘gathering data.’ The only eommonly intended performanee expee- 
tation (in the eurrieulum guides and textbooks of 70 pereent of the eountries) that was 
also emphasized (in 6 pereent of textbook bloeks) was ‘understanding simple information.’ 

• The eommon expeetations for the upper grade of Population 2 were more varied, eov- 
ering a wider range of performanee expeetations — ‘abstraeting, dedueing seientifie 
prineiples,’ ‘eonstrueting and using models,’ ‘eondueting investigations,’ and others. 
However, only two expeetations — ‘understanding simple information’ and ‘under- 
standing eomplex information’ were emphasized. 

• For the physies speeialists of Population 3, performanee expeetations were widely present 
in both guides and textbooks, although less than those present in Population 1 and 2. The 
performanee demands of the textbooks were generally less varied than were those of the 
guides — the opposite of what held tme for mathematies speeialist textbooks. 

These eommon patterns again emerged against a baekground of eonsiderable eross-nation- 
al variation. This was tme whether attention was devoted to whieh performanee expeetations 
were used often either in guides or textbooks, whieh were used for partieular seienee topies, or 
whieh seienee topies were most often assoeiated with major eategories of performanee expee- 
tations. Similar analyses were eondueted on relative use of diseiplinary perspeetives — the 
third aspeet of the TIMSS seienee framework — but little of eonsequenee was found. 



Investigating Shared Visions (See Chapter 9) 

In searehing for shared eurrieular visions, it is also important to look for those shared 
by some, but not all, of the eountries. To this end, we looked at the eurrieular intentions of 
eountries grouped by identified a priori eonditions sueh as geographieal region or average 
national ineome. 

Regional eountry groups were examined, and the average pereentage of textbook eoverage 
for eaeh topie in eaeh region was eompared. There were some differenees eharaeteristie of 
some regions, sueh as remarkable differenees in earth seienee topie eoverage at Population 2 
and in treatments of topies sueh as ‘interaetions of living things’ and some physieal seienee top- 
ies in both Populations 1 and 2. Similar analyses were performed for eountries grouped into 
four eategories of national average ineome used by the World Bank — high, upper middle, 
lower middle, and low. With a few striking exeeptions, most of the differenees found were 
small. Why these differenees exist is a matter for eonjeeture and future investigation. A fur- 
ther analysis of European Union (EU) versus non-EU eountries revealed few differenees and 
none that were remarkable. 
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Statistical clustering methods were also used to form groups rather than use a priori eate- 
gories. In this analysis, we foeused somewhat on unexpeeted similarities revealed, but eonsid- 
erably more on determining whieh seienee topies were the basis for the different groups formed. 
A few topies were important in distinguishing groups. At the upper grade of Population 1, top- 
ies sueh as ‘eleetrieity,’ ‘types of forees,’ ‘land forms,’ and ‘bodies of water’ were eentral in dis- 
tinguishing several groups. ‘Eleetrieity’ was also important at the upper grade of Population 2, 
as were ‘light,’ ‘magnetism,’ and ‘earth in the solar system,’ among others. 

The results represent only a first pass at analyses for limited eountry groups. This area 
seems a valuable topie for further work, both to identify salient differenees and to eonfirm or 
disprove traditional eonjeetures about eross-national differenees based on sueh eriteria as 
regional differenees or eeonomie affiliations. 

Concluding Remarks (See Chapter 10) 

One major theme that arose during our analyses was that of pervasive and detailed eross- 
national variation. Currieular data vary among eountries in myriad ways both small and large. 
Any use of these data must keep this variation in mind. This suggests a seeond major theme — 
that any eomparative data must be understood in eontext. Cross-national eomparisons are 
intended to provide information about eurrieula, edueational systems, national goals, and how 
well national goals are being met. Comparisons ean do that only if they are made on faetors 
sensitive to the effeets of eurrieulum and edueational systems, and if they are relevant to nation- 
al goals in seienee edueation. The analyses presented here suggest that eomparisons will nee- 
essarily have to eonsider sensitive faetors — and eross-national differenees regarding them — 
in providing a eontext for findings and an appropriate basis for interpretation. 

Other themes worth noting inelude possible limitations on a priori group eomparisons. It is 
common in comparative edueation researeh to find that groups of nations formed on eeonomie 
and regional eriteria differ in some edueationally important ways. The results here, while pre- 
liminary, eaution against over-optimism that this observation ean be validated empirieally in the 
ease of eurrieular faetors. 

A final pair of eonelusions deal with doeument analysis. Large-seale eross-national eom- 
parisons previously have relied mostly on survey and expert data. Doeument-based data have 
been reserved for smaller seale studies with limited eomparisons. The present investigation 
suggests that doeument-based data gathering and analyses are feasible on a large seale and ean 
yield useful data. On the other hand, these investigations have shown how demanding sueh 
researeh is and revealed some of the limitations inherent in the sort of statistieal abstraets of 
doeuments that appear to be neeessary for large-seale doeument analysis. 

More must eertainly be done with TIMSS data and more is planned. Investigations are 
planned for the strueture of textbooks and for the relation of textbook form and funetion. As 
the full sets of data beeome available, analyses will be made to relate intention, implementa- 
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tion, and educational attainments. Further studies are needed using these data to investigate 
intracountry variations in nations with regional and other subnational education systems and 
varying science curricula. Also, there should be further investigation of limited country groups 
to find substantive similarities related to national and educational system factors. 

The TIMSS ambitious data collection holds promise for future analyses. However, it also 
revealed important omissions in its design. To rectify the limitations caused by these omissions, 
direct data are needed on sequence and topic emphasis; documents other than curriculum guides 
and textbooks must be analyzed; data on the role of textbooks and cross-national differences in 
that role need to be gathered; and more detailed information on curriculum guides ought to be 
obtained. 

One set of curriculum analysis methods has been used for our large data collection. Other 
methods can provide additional insights. What we have presented in this monograph is only a 
beginning. More is planned for primary analyses in TIMSS; more should result from eventual 
secondary analyses and from the further data collections suggested by these analyses. 




II. Curricular Organization and Control 
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Chapter 3 

Seeking Shared Visions Among the Many 

Our investigation seeks eommonalities in the edueational visions and aims of the various eoun- 
tries partieipating in the Third International Mathematies and Seienee Study (TIMSS). Before 
those eommonalities ean be sought, however, we must first aeknowledge and understand the 
differenees and similarities aeross TIMSS eountries. These eountries differed markedly in their 
edueational systems. For example, they differed in terms of the age at whieh students entered 
sehool, the number of years sehooling was provided, the number of years of eompulsory sehool- 
ing, and how grades were elustered. They differed too in the level at whieh deeisions are made, 
in how eomplex the internal struetures of their edueational systems were, and in whieh deei- 
sions are made at eaeh level. And, while eountries shared eertain broad-based agreements — 
for instanee, virtually all eountries required seienee instruetion and tended to eover the same 
general topies — their approaehes to seienee edueation varied widely. They struetured and used 
their eurrieulum guides and textbooks differently; they sequeneed their eontent differently; they 
had different eoverage of seienee eontent areas; and they held different expeetations of student 
performanee, both globally and within any given topie. 

This ehapter elueidates some of the key differenees and basie similarities aeross TIMSS 
eountries. This information provides a eontext against whieh to understand and evaluate the 
more detailed eurrieulum-speeifie findings outlined in seetion III. 

Comparing the Structures of Educational Systems 

National educational systems differ widely in their organization, their curricular organiza- 
tion, their degree of homogeneity, and their decision-making processes. This section examines 
these diversities across TIMSS educational systems. Only after these essential differences have 
been distinguished can similarities — broad or specific — in science curricula and educational 
opportunities be investigated. 

System Organization 

National educational systems determine school entry ages, the number of years schooling is 
provided, the number of years schooling is compulsory, and which grades are grouped together. 
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Table 3.1 summarizes information about these faetors gathered from TIMSS questionnaires 
eompleted by representatives of partieipating eountries and from related United Nations 
Edueational, Soeial, and Cultural Organization (UNESCO) data. 

Though it remains a matter of some debate among seienee edueation researehers, students’ 
eognitive development and maturation are eommonly believed to affeet, and perhaps even set 
limits on, what are eonsidered to be eurrieularly appropriate edueational opportunities to foster 
seienee learning. The possibilities for providing these edueational opportunities differ eonsid- 
erably among TIMSS eountries. In most TIMSS eountries, pupils began formal sehooling at 
either age 6 or 7. Only three eountries — Cyprus, the Netherlands, and Seotland — began eom- 
pulsory formal sehooling before age 6. In three eountries (the Russian Federation, Sweden, and 
Switzerland), students began at different ages (either 6 or 7). There also were differenees in the 
number of years for whieh sehooling was eompulsory. This ranged from 12 years in two eoun- 
tries (Belgium and Germany) to 5 years in Colombia. About half of the eountries required ehil- 
dren to attend sehool for either 9 or 10 years. 

There was more similarity in the total number of years ehildren would have to remain in 
sehool to eomplete primary and seeondary edueation — that is, in the total years of sehooling 
provided by TIMSS eountries. The majority required 12 years to eomplete sehooling through 
upper seeondary, and another 13 eountries required 13 years. Only three eountries required 
fewer years of pretertiary sehooling: Colombia (11), the People’s Republie of China (10), and 
the Russian Federation (10 or 11). 

Sehooling typieally is segmented into two or three elusters of adjaeent grades — primary or 
elementary sehool, lower seeondary sehool, and upper seeondary sehool. These groupings ean 
refleet differing sehooling approaehes, polieies, resouree distributions, student peers, eduea- 
tional opportunity distributions, and other differentiations in sehooling possibilities. 

Groupings differed eonsiderably among TIMSS eountries. More than a third of the eoun- 
tries had about six or seven grades of primary sehooling, followed by two or three grades of 
lower seeondary and 3 or 4 years of upper seeondary. There were many deviations from this 
dominant pattern. In Hungary, for example, students followed 8 years of primary sehooling 
with 4 years of seeondary. 

These differenees in the age at whieh students begin sehool, the years of sehooling, and the 
organization of grades have important eonsequenees for understanding the eurrieulum analysis 
data. There was no eommon age, for example, for ehildren in grade 7. Countries also differed 
in whether they eonsidered that grade part of primary or seeondary edueation. Table 3.2 shows 
how five typieal TIMSS eountries organized grades in their edueational systems. Even this 
small sample illustrates the eonsiderable organizational differenees among eountries. 

Table 3.2 also shows how these grades eorrespond to the populations for whieh TIMSS eol- 
leeted aehievement data. By design, these target years also eorresponded to grades from whieh 
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Table 3.1 

Differences in National Edncational Systems. 

This table presents information on which grades were clustered together, on the number of years of compulsory 
education and years of education offered, and on school entry ages in various countries. Cross-national differ- 
ences are clear. 





Grade Sequence 


School 
Entry Age 


Years of 
Compulsory 
Education” 


Years of 
School 


Country 










Argentina 


1-7,8-13 


6 


7 


13 


Australia 


1-6(7), 7(8)-12 [or7(8)-10,l 1-12(13)'= 


6C 


9,10 


13 


Austria 


1-4, 5-8,9-12 


6 


9 


12 


Belgium (FI) 


1-5,7-8,9-10, 11-12 


6 


12 


12 


Belgium (Fr) 


1-6, 7-8,9-10, 11-12 


6 


12 


12 


Bulgaria 


1-4, 5-8, 9-12 


6 


8 


12 


Canada 


l-6,7-9, 10-12 


6 


10 


12 


China, People’s Republic of 


1-5, 6-7, 8-9, 10-12/1-6,7-9, 10-12 


7 


9 


10 


Colombia 


1-5, 6-9, 10-11 


6 


5 


11 


Cyprus 


1-6, 7-9, 10-12 


5.5 


9 


12 


Czech Republic 


l-5,6-9, 10-13(14) 


6 


9 


13/14 


Denmark 


1-9, 10-12 


7 


9 


12 


Dominican Republic 


l-6,7-9, 10-12/1-8, 9-12 


7 


8 


12 


France 


l-5,6-9, 10-12 


6 


10 


12 


Germany 


1-4,5-10, 11-13 


6 


12 


13 


Greece 


1-6, 7-9, 10-12 


6 


9 


12 


Hong Kong 


1-6,7-11, 12-13 


6 


9 


13 


Hungary 


1-8,9-12 


6 


10 


12 


Iceland 


1-7,8-10, 11-14 


6 


10 


14 


Iran 


1-5,6-8,9-12 


6 


8 


12 


Ireland 


1-6, 7-9(10), 11-12“ 


6 


9 


13 or 14 


Israel 


1-6, 7-9, 10-12/1-8,9-12 


6 


11' 


12 


Italy 


l-5,6-8, 9-13 


6 


8 


13 


Japan 


1-6, 7-9, 10-12 


6 


9 


12 


Korea 


1-6, 7-9, 10-12 


6 


6 


12 



a For some countries the number of years of compulsory education is given only for those students in a general course of study and excludes, for example, 
those students in vocational programs. 

b In Australia, only the state of Tasmania has a substantial number of students attending grade 13. 

c In Australia, although compulsory schooling begins at age 6 (grade 1), most children enter a non-compulsory preparatory year with a formal curriculum. 
d In Ireland, grade 10 is an optional “transition” year currently being introduced in all schools. Nearly all children enter school at age 4 or 5, attending non- 
compulsory pre-primary grades with a formal curriculum. 
e In Israel, compulsory education consists of 1 year of pre-primary and 10 additional grades. 
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Table 3.1 (continued) 

Differences in National Edncational Systems. 





Grade Sequence 


School 
Entry Age 


Years of 
Compulsory 
Education* 


Years of 
School 


Country 










Latvia 


1-4, 5-9, 10-12 


7 


9 


12 


Lithuania 


1-4, 5-9, 10-13 


7 


8 


12 


Mexico 


1-6,7-9,10-12 


6 


9 


12 


Netherlands 


1-8, 9-11, 12-14 


4 


11 


14 


New Zealand 


1-8, 9-13 


6f 


10 


13 


Norway 


1-6, 7-9, 10-12 


7 


9 


12 


Philippines 


1-6, 7-10 


7(6)« 


6 


10 


Portugal 


1-6,7-9,10-12 


6 


6 


12 


Romania 


1-4, 5-8, 9-12 


6 


10 


12 


Russian Federation 


l-4or 1-3, 5-9, 10-11 


6and7 


8or9 


10 or 11 


Scotland 


1-7,8-13 


5 


11 


13 


Singaporeh 


1-6,7-10, 11-13 


6 




13 


Slovak Republic 


1-8,9-12(13) 


6 


9 


12(13) 


Slovenia 


1-4, 5-8, 9-12 


7 


8 


12 


South Africa 


1-7,8-10,11-12 


7 


10 


12 


Spain 


1-8,9-11, 12 


6 


10 


12 


Sweden 


l-3,4-6,7-9,10-12‘ 


6 or 7 


9 


12 


Switzerland 


l-6,7-9, 10-13 or l-4,5-9, 10-12/13 


6 and 7 


8 or 9 


13 


Thailand 


l-6,7-9, 10-12 


6 


6 


12 


Tunisia 


1 -6,7-9, 10-13 


6 


11 


13 


USA 


l-6,7-8, 9-12 


6 


11 


12 



/ In New Zealand, most children begin schooling at age 5, although age 6 is the age at which compulsory education begins. 
g In Philippines, school entry age became 6 in 1995. 

h General education (Primary 1 to Primary 6 and Secondary 1 to Secondary 4) is provided for every pupil in Singapore. It is, however, not compulsory 
i In Sweden, the grade structure has changed to 1 through 9 and 10 through 12. 

j In Sweden, students enter school at age 6 or 7 at parent's choice. 
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Table 3.2 

Organizational Differences in Five Typical Conntries. 

This display of how grades were grouped in phases of schooling in five countries clearly illustrates the strong 
organizational differences among countries. Indicating key grades for TIMSS achievement testing makes it clear 
that these difference have implications for testing. 



2 3 4 5 6 7 



1 2 3 4 5 6 



2 3 4 5 6 



Russian Federotion 



1 1/2 2./3 3/4 



2 3 4 5 6 



lower Secondary 



7 8 9 




Note: These numbers represent international "grade equivalents" — that is, 
years in school counted from the beginning year for each country. 
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more detailed eurrieulum analysis data were gathered. As shown, for example, the upper grade 
for TIMSS Population 1 for Norwegian and some Russian Federation ehildren was grade 3 
rather than grade 4, as was the ease for most eountries. Similar differenees oeeurred with 
Populations 2 and 3. If aehievement attainments are primarily linked to age-related development, 
these differenees should have few eonsequenees. However, if attainments are related to sehool 
arrangements and opportunities, sueh differenees eould result in distinet attainment differenees. 

Curricular Organization 

Aeross the TIMSS eountries, the seienee eurrieulum is organized differently, with notable 
variations in the organization and sequeneing of opportunities to learn seienee during speeifie 
grades. In many eountries, eaeh student reeeived more than one seienee eourse per year, and 
there were a variety of eurrieular streams in whieh these eourses were situated — espeeially at 
grades 10 and 11. For example, students might reeeive seienee as a part of seeondary seienee 
or teehnology traeks or in a baeealaureate' program. Seven major eurrieular traeks existed in 
Franee; no sueh differentiation existed in Japan. Other data indieate that in Israel, for example, 
even though there is no formal traeking distinetion from grades 1 through 9, students reeeived 
seienee instmetion not only in their elementary and lower seeondary seienee eourses, but in 
grades 4 through 12 they reeeived earth seienee instmetion in a separate geology/geography 
eourse with biology, physies, and ehemistry being taught separately from grade 10 onward. 
Chemistry and physies are also taught separately starting in grade 10 in Mexieo, with separate 
eourses on seientifie method and biology eovered in grade 11. In grade 12 there are four sep- 
arate eourses: biology, ehemistry, physies, and geography (whieh eontains earth seienee topies). 
But by no means do eountries teaeh the seienees as separate diseiplines only in upper seeondary. 
In the Russian Federation, for example, students reeeive separate eourses in biology (grades 6 
through 11) and earth seienees (grades 5 through 10), with eourses in physies and ehemistry 
beginning in grades 7 and 8, respeetively, finishing in grade 11. 



Curricular Decision Making 

National edueation systems also varied in their internal eomplexity. Some were tmly sin- 
gle national systems; others were aggregations of smaller (regional, ete.) edueational systems. 
In most eases, an overall national system eoordinated the aetivities of the sub-systems. In other 
eases, (for example, the United States) the regional edueational systems were relatively 
autonomous with only indireet national influenee. Countries ranged from those having a sin- 
gle national system (for example, in Korea) to a eomplex, varied hierarehy of sub-systems (of 
whieh the 50 major sub-systems in the United States were an extreme example). Most TIMSS 
eountries had fewer than five sub-systems. 

Edueational deeision making and poliey setting are likely to be affeeted by the eomplexity 
of national edueation systems. Countries with a single, homogeneous system ean eoneeptual- 
ize, artieulate, and deeide upon eurrieular ehanges with relatively greater ease than eountries 
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with more complex, heterogeneous systems. Curricular decision making and change become 
more difficult with increasing heterogeneity. 

Spain is a good example of a relatively heterogeneous national system. It had several major 
types of sub-systems. There were public, religious, and non-sectarian private sponsorship of 
general basic education, and baccalaureate and vocational sub-systems operated throughout the 
country. The same types of institutions had sponsored similar sub-systems limited to 
autonomous communities within Spain. The resulting “national” educational system was one 
with considerable diversity in curricular authority and in the locus of authority for educational 
decisions. 

Countries also varied in terms of how they approached educational decision making. 
Decision-making authority may be relatively centralized or more widely distributed, with 
authority shared by central ministries, schools, teachers, or combinations of these. Within the 
country’s national systems and sub-systems, different agencies had decision-making jurisdic- 
tion over different aspects of science curricula. Italy, for example, had only one national edu- 
cational system but three different sites for decision making: the national ministry of education 
which had sole responsibility for all decisions relating to national goals, instructional content, 
and examinations; teachers committees, which were responsible for textbook selection; and 
individual teachers, who had exclusive responsibility for lesson planning and instructional 
methods (although the ministry provided advisory recommendations). 

Japan, on the other hand, had three educational sub-systems, yet all decisions regarding 
national instructional goals and content were the responsibility of the national Ministry of 
Education, with the advice of the Central Council for Education and a sub-committee composed 
of scholars, teachers, administrators, and persons from industry. Teachers’ associations served 
in advisory roles. No other agencies contributed to decisions on these issues. 
Prefectural/municipal boards articulated their standards based on the national course of study. 
Teachers in all three sub-systems decided on instructional technique. Individual upper sec- 
ondary schools selected the textbooks to be used. In elementary and lower secondary, textbooks 
were selected by prefectural/municipal boards of education with the advice of teachers. 

In TIMSS countries, curricular decisions on national goals, instructional content, examina- 
tions, and so on were made by groups, agencies, individuals in authority, or some combination 
of these. Each country participating in TIMSS was surveyed regarding these decisions and the 
various authorities involved. Overall, central authorities made more than 40 percent of all cur- 
ricular decisions, individual teachers about 17 percent of all decisions, and schools about 6 per- 
cent. About 26 percent of all decisions were made jointly by more than one source of decision 
making. Other data show that decisions concerning textbooks were made jointly in about 42 
percent of the systems and sub-systems, most often involving a central authority and the school 
using the text. Individual teachers chose the textbooks for their classes in only about 9 percent 
of the systems and sub-systems but were responsible for planning lessons in 65 percent of cases. 




Table 3.3 

Summary of Science Reform Interests in a Representative Set of Countries. 

Widespread interest was expressed in seienee edueation reforms. This table summarizes reform interests in a representative sample of 
TIMSS countries as provided by experts within each country. 



34 



MANY VISIONS, MANY AIMS 



s 

PS 









s 

5 

O 



U 



I 



c 



O 

Bug 

3 75 .£3 

H § 3 

75 ^ O 

^ (L> -C ^ 

^ 5 = 00 

sir ^ 

^ g C3 

M gii 13 



U (U 

s.i 

O 3 



4D -O 
blD c3 
3 Fi O 



! 3 



■S u 



g s s 

il-2 

O fa iS bX) 03 

^ r*5 

2 ^ fa Cl- 

,2 a 2 

3 a ft 

,2 g-S-K 

o -a 

03 o3 «U O 

O 75 

■ft S 8 ft's 
go'S^ § 

U*3 ft c3ft 

O g O U 3 

•Hu ^ s 
g g 

"o 3 -i g I 

o.ft 2 u 2 
o o> "is fa 
S u u u 3 

3 C g c ^ 
> u ft u ^ 
U'3 <a ft^ 

8 -g 

uft.S-^ 3 

"o ^ "fa 0 ^ 
— o3 bX) fa 

0 &S-ft ^ 

^ 3 3 3 
t».S .3 ft u 
U u 
3 2 3)0'> 
-ftft s:n u 
ft r'ft’ft 

S 3 t 3 u 
3 3 U 
ft ft 03 2 
u u 3i3 tjS 

U o co^ ^ 
■3 3 ft 3 U 

ft.2 ft's 
m 2 8 uiS 
ft-- 3g| 

75 ^ 75 O ^ 



g 2 g ® “ 

u ft u c ft 

ft &-ft §r 

o3 H ’-C Cli 



g ' 75 fa 
• fa O (U 

75 fa 75 

(U ^ ^ ^ o3 

fa'^ 

.ft ^ u.ft 

2 ft " 

3i> 3 3.3S 

•rt ... — 

I 2 ft.O M 



^ M g ft 



S o ^ 

.ft ft 3 

SPs'o 
“3 



<u 



(U 



75 

0> 

o 

fa 

fD 



03 ■ 

fa. 



^ . , o ftrS 

3 S 3-^30 

d ^ fa ^ r:! 

O O §■ ft ft "3 

c/5-gft 3^'i 

f— 'IT' 0.) 

•-"s-isS 

sr'ft s.g 

ft ft ft S3 
ft 2 
"S ft 

=^^ft 

- QJ.S'-.g ft 
.33 gC^.y'.ft 

SS2-g|3 
&3 - ft ^3 

o-§i;gri 

o . ^ r5 fa 
o 0> 
fa Q 
(-M fa 

S gi - — ^ 

■fa 0^ Q O 

“2 ft 
i^ft 




75 (U 



.§ 2 ft 3 . M 
g ft.g'5 SS 

>'S hft o 



u 



3 3 g 
3 



ft 3 3 ft S ft3 

.. ft S ft ft. 2 . 5 ^ 

3 O !> U 3 3 

^■ft S ft'S..2 
13 > ft” g'M 

■'• 3 ft. 2-2 3-ft 
r' r^ » . 



^ ~fa O o 
fa.fa-^ 



>.2 



O 

fa 






3 ^^ft-B;n2 

> g g^ft^o 

fa o 

“5 3 ft ft 
fa 1> ^ .£fa_o 

3 .^.ft ■ftft' 

If 111 

fa fa o grfa'farfa 

<■[3 .S ■g l'> 



fa 

> 



fa 

fa 

t: 

o 

p; 



75 ^ 



fa 

o 



^o> 

fa 



fa 



■fa 75 , . 

fa — o 
(U o ^ 

5— o 

g: 2 3 

'tS ^ ft 
•ft &• 2 

g-S- 

cvfa fa 
50 o*^ 

^ o*fa 

I <u 

75 ^ 
r- fa 

■•S <u 
0> o 
p fa 
fa p 

(u.2i '>5 -j 

1 2.S M 

O’fa^'fa 

• is ^ 0*2 

> fa 

fa *- -fa — 
(U ^ 0 ^ 

... 75 fa 

2 ^ 

fa'^ •— 72 
T3 0> 75 O 

■I ft-l'l 

•"3 &'ft 

75 S 

-§Sr-l 

ft 3 ft S 
'"■r ft § 

u s C03 

12^ 13 ft 
g '^'R S' 

J- 0> ^ .fa 

• fa '.fa fax 

ftisr 3 

•3 ft-2 
o> o> 

75 

^c2 

ag^.-g 

ft-O o 

ft g-g 
> 2 
ft.i 



(U 



0> 



“’p 
. fa 
fa 



fa 

.2^ — 

"fa to -2 § 



u 

(U 



(U 

'fa'^ 

J- fa= 

(UT3 O 



^8 g ft 
ft 8.2 g 
ft 3 tics 
ft ft) ft ft 

O fa^ ^ 

75-S (U-rt 
r^-P «- fa 



0> 



^ (U ’ 



2-H 

fa fa 



fa r. 
O t>5 

•fcPS 

^CJ 



o> 



tT P 

0.2 



3d^ 

•2ft 

"fa o 

3-S 

ftft 

O 75 

CLfa 

r-2 

2 

S 2 

fa bX) 

gr 

3 o 
g ft 



ft-? 

03 

75 . 
2 



bX) 



oxh:; 



a> - 
fa-fa 

(U ' 

■S ' 

fa 



fa Ph •■: 

• fa tyn .y 

s’H “ 

r 3 g 
.2 g"S 

H fa 
fa fa 2- 

ft &§■ 

.sig) 

o.fa 

■2 

fa o P 
o a 
•fa fa 

*rt_^ 75 
^ o> 
<BH 



-fa 
I fa 
fa fa 

O r. 

fa 
> 
fa 



(U 



0> 

fa 

o 



^ 75 

1> 75 S- 

0> O 
fa fa 

!o 75 fa 
(Ufa 

8l 

S.2 



2 

rTi 

fa 

(U 



(U 



fa 
fa o 

ft'g 

-fa -» 
fa o ^ 
-fa 

fa 

0"d 

^ 75 (U 

(U _s- 

o ofa 
ftc2^ 
ftft . 

L> (U 03 
2 

-fa jC 

rfa 



>fa 



*!•> S rb 
(U 

i- fa O 
Ph 

(U’P« 
r= fa <u 

■iSr 

!> fa t£ 
fa ^ 

“i| 

o> ^ 



4 

P 



o ^ 



h 

2 ^ 
S 



fa -— 



(U ■ 



fa • 

■§. ^ 
fa 52 fa 

fecg-ft-ft 

fa (U 

ftftr-r 

ftll3 ft 
U 2 3 ft 
3^3 g 



u 



!- o a 
. 8'm| 
S ft_ 8 
33^ g 

a ft 3 *- 

■53 .2 

ft o-ftl. 
■fa i- ^ fa 
fa ^ ^ 

Q 75 O 0> 

b> "q O 2 

■iiR§- 

ft Z3 a> 
2ft - o 

g-2-S S 

3 bX) (Ufa 

u 2 S > 



(U - 

•"§ 

fa 

«u 



fa I 

.2j= 



fa 

fa 

fafa ^ 

*- fa -fa 

(U O 



I g c« ■! 2 
B 2.ft ft-T^ 

u. 3 3 r. S ■? 3 

3 ft g 8 gr Uii 
O'En u 2 MtO 

ft °-3 B ft ft 

3 0-3 ftg O-Ri 

.si-? 

fa 



o ^ 

p (\J 



p - 

e .fa (U 
s- 75 
0^0 

J-ft US’! 

ft-a.3 3.3 

R ii 

ft g ft 3 

2 



(U 



o S 

}— • 1 — 
fa 

(U o 

fa 
^ fa 

sr “ 

,2 M-q 

+H 03 ft 

75 ^ CL 

ftT._ 



u 



83 ft -§13 J-2 
3|)g|;2:^:g> 

$0 §3.:g 3 

3 ft .-« 3^ S 
>,0 ft 



3 u S m"'3 2 2 

u^g ft ft'^ s O 

8^ 13 ft 13'*^ 
2 ft g-g.S.S.ft'r 

GSt'^fafafafa^ 

r- P75faGfaCc±£ 

3 3 ft &ft^ 

fa fa Q -fa 

■2'5i«'ftftftM3 
ft - S-3S3.C - 



t/3 



g ft o .-3 -S ' ? ft 

fa .fa r/b U( ^ 75 fli 



8^.2 ft 



75 0^ 
<U O 

o 



■fa ^ ^ 

_ .^ 03 • .V S- 03 



g 3 I u;s-S ft 
s.-fa g-O 

ft 3 ^M.. 

ftgil^fS^ 
8 8-2 

fas -2 

^ OQlb 

00 O 5^ fa ’ — .p S- • 
00 clP'' B'O o^tP bX) 
^ ^ r-.-fa fa 



fa -_p o 
> 75 S fa 

q-2 (u 75 
^ 75 (-1 •’- 



00 O Ph j- 



C\ 



o 

75 75 H -^ • 

•2 b22 ft^ 3 

75 Q 75 X 75'^ 

^ft^sr ft B 

CL-^ CL S P 



fa 
O 
S 

P — 

50 o3'Tfa fa 



«U' 



fa- 

03 



.. o3 P 

■ft 3 S’ft 
M ft.2 u S 

^ 75 ^ 

M" O §)'B.2 ft-M 
.3 m 2 ft B-ftl.S 

2 ft ^ 

:= s-s 8 u'ft -• ^ 

c2 3 - 8 ft 



o 

,i-i 



B fa 



fa ^-iu o a> 

5 75 -.fa 75 

fa S p fa’p fa fa 

O N-fa 






•2'S o3 

fafa 

(U (U 

}- CL 

CQOtL ^ 



03 

3 

s 



fa Ph ^ 
-fa O CL 

S S p 
UclpS 



^ s 

(U Ph 
N P 

UPS 



fa 

(D 

o 







neering, medical technology, production technology, etc. 



SEEKING SHARED VISIONS AMONG THE MANY 



35 



bX) 

C 

o 

'5b 

'o 

s 

"S 

> 



(U 



o 

c 



a 

o 

0 > 

2 

o 



(U - 






R'S 



-rtt3 bi)+^ b g 
rt .2- d 

3 o <u 

C3 r« % S-fi.y S 

ji-S 2 c S g)ft-S 

? ^ C C o 

r-| <L> ^ ^ 



>75 • Ji 



03 

r/ 0> 



M s ° ri h a> o ft 



^ = 
0 > 5^, 



_I '-'W 



^ I g,'^^. 2 ^ o 
■5^ 2 g’ft §22 buS 
° 2 ftftS g^g.Soo 

>75 

o3 
' u- 
rbX) 



?=-S 



"§ ooo g 
bX)— c 2 ^ f^ 



75 g § ^ 'S ’tJ S 
'g^'^'75 2 ^ 



03 



(U o3 . 
• a> C 



^ a 2 ’ 

t O O W c- 75 Oj C 

ftt» S o ^ 

C 75ct3>^2f5i^ ^d> 

s 5 R-S 

s-^ -b — 

O ^ "tb 75 ^3 

s -55 g . 2 S =« 

2 o 3^ ^”2 
« S - 



|S8 

o >>5 

Bol3« c-R.SJ g| 



3 o ^ 

R.iS (UT3 o 



ft^ I J g g g 

•S-2 & o ftg 3 



- 3 &- S -^ 
y i- OJ S 



—I 

R= > 



^2^;^'p|s|g 



c 



a> 



3 ftS-^ a> ??ft 
5 ftS fto o 3 
§ =^.2 s.S.s c'S ^ 

2 t/5 bp. 

g 2 ^ T3 ft S ^ 

“ gg c'^.S 






„ o> g'^ R 

bx) 9_ P » • 

.g ^ 2 'S-"ft 
" (u'S 
3 3ft 



"•fto 3 — .'-' 

■g Uh 0 > C C 3 ■ 

" ft ” ■ 



S-ftS § 5 



« 2 

g _0 3 

g33 g^P ftS o b 
t) oft 3 oftcyoft 



3 

oft 3 



^ ft 
ft S5 o 
■Kg c» 

O-rt 2 O -s 
Mg gft^t" g 
bO § s ft 

IS ■>. Pft ft 3 

■'^ > =« ft'-' 

i 3 -rt fto 
> <u o gft 



3? 

oft 

t§-i 



g £,^3^ N ^ 
p s- r^ ;s -i2 

^ gftft^ §ft 

'*7' 75 p -^43 C 

bX) p a> ^ • 
.3 3.ft O u >^-g^ 

X p o '>^’ 2 ’^ s- 2 
o *i> is 2 P S 



3 3 

(*5 ’*^ 

• 3jyft O 2 
CO oftft ^ S 
b oft 3 o >- 
o ^ - o ft 
>^■5.3 g 

2 ft ^ 8 3 

ftft CO o o 

fe-3^ g-g-g 
s'"! 

ft 0.2 "5 

ft- 2 §Sg 

p 

.2 cx) 

p 2 
2 o>-Sx 

»*x. f . . 

> ^ (U 



2-3 3 
ft f/i' — ' 

o *= 2 
g.P.3 
03 • 




— ' is 

o (U 0 ’S 



-^.2 o 



•R 2 o ^ . 

ft CO o 3 £? 
ft 3 

ft's £>.3 

g'ggogo 

o>^- ^ 



P ;-( 

a ^ 
Sg 






^ ^ <3j ^ 

S 2 

■ 

u- X 

— S^ p -p 

3 § ^ O c/5 

oo,’--]=_g 



. >-— 

- 2 ^ ^ 



^ y — — ►-'ft 

Pj'S 3 3ft V, 
ft- o 3 O 
3 M 3 -gSft 

‘1 8 R 



3 

75 Oh 



M‘l 



O _ 

_ g 



I.S 



■'S'ftPftftft.S 

3. oft3ftgftb0o 

g^.” sS ^ g g’ft g 
esp&^llibo 



13's'^e 



o p 



75 U( ^ ^ 

p o 2 ^ fax o 

S x*^ 



o> 

i> ^ ^.5 "p x^^ fa 

s g)S? ^Ijs .2 



-rt X ^ SR 
3 3 2^2 g' 



- 35' - 

c§ 3 O 3ft 

3>g^2 
8 biD g § g 
■ft 3 o(N g 
S oig-g^ft 
g S Ocg 

o O ftl i- O- 

3d^ 2^2°S- 
gS2'"Sftpo3 
3-cftoSft^-5 
ft CO '"ft.S Pcft 2 

Q> P 75 K R X *0 

H ^ ' 




b s's g o 

s oftftft S 

O S- ft O-ft 
ft 3 o CO 3 

3 ?? S'S ftRS 
3 o S .2 
2 - 3.2 3 

'-''-' -.ft 



o 



o 



5 3 ft ft o <; 
Jft ^ > 



75 0> ' 
H- O 

3 3 
o o 

2'o 



o 



R-’Sft I 

^ 3 >, 



O 2 oft^ '".3 3)3“ 

ftScogi- 3 S ^2 ^!2 

(D ft. P O P P'^X. T3 



3 gS^-g 

gSi^ft 3 g ”Ko g 



o 75 



3 o 3ft >ft -g ^ ^- 



3) i 



§3.3 



.g^'S O So 
Hft_ 0 'S 

gS^t^ >.3-"-- - '-'■ft 
3 oS^ fe>,p g ^ oft 3 



2.2 

o • 



'p fa O X P 
oi o P ^5 
oo t^ P O P 
X fa X X ^ ^ 

>• 2 fa X 3 
0 ^ 1 -P O ^ X ^ 
ft ^ &2t/5 ° 

S =« 2 -ft ,S 
0.2 Jift 2 

^sl’i I ft 

B ^3)3 2 > 
o KA o> 
ft- g'g- 2 ft 

-12 ^ S’S 

8— 2n2 ^ ■ 

3 O '^.2 -J- ft 

0 'S -B 3 3."“ 



ft _ „ 

® o.3ft 

8 g'|:.sS| 8 g-|gs 

O'Sw’g-.g 8 3)3^0^ I 3 

2 g bftb g^S^oBgo 

•" S SS o o '".ft 8'3 

— ;s32g„OMO,8o 
o ft )0 oB ft 8 2 2 ft>- - 
2 g g g. 2 S ”-2^:3 

S g-2 ^ 3)g'g O g mS ^ 
75Po75t^(UPO_ 

E« 2 f ^2 2 T. — BS'o 2 



, 0 > >>(U P _'p_ -_ 

p(u2fa^»>'i4^2’^o’- 
Q^-ppP^p'fapPtU^ 
^ -rR2Xi^^>Ti-2 

- *- C->-— bX) 0> 75 p S 

(U ^ O 75 (U 

sB. 2 'io g 
5— <« fe>o 

SPS.d'q.B 3. 



ft B ft> 2 

^ Cj— O 



75 ^ 

2 ft 



° 8 ^ 
- S ° 

ft o 



P><L>PP’^^fa 2 

ni^a>_Spfa-‘'Ps 2 ^X 



< > 75 

'. gS^ 

w lJ Oh D. 

^ (U X p fa^ r: 
g bp".o 3B 3 



Oft 

S g^ ■ -- 

3 3?ift 
,p bX)P 

P ’2 
o ^ 



OhoC 

fax’ 



-T3 
■ P 



fa’s)© S 

^ 2ft 



bX) 



D 



P 



IX: 



(U 



-_' P 

fa ro 
P 



— P S 
o *- fa 
cj 5- b X) P 
75X ^ oX — 

§'C.ls*=“ 



-2 

OX 



_JJ li/ «-H ,_i, 2 

P _^SX P o P 



3J Sr3 3 o , 
c5ft 3 S'— o 
ft 0-3 CO 0-3 - 



o 3 



3 ft 3 
-§|.2 

o o 2 S'" 5~' 3 "ft„ , 

g'S-^ o £?o^ 3 3 gft 
p 0 -© S-© o 2 
^ 3)S 23>3o2oB§ 
u . 2 . 2 o 3)B 2 d 8 o S 3 s 






' 3 
o u g 
— -K O 
O g 



ftft g 

is'-B 



fax 



o 
P . 



:!x. 



X I I 
O Oh P 
fa rc P P 
Oh 75 75 O 

1 . 8-2 

2 - 



fa .2 S S 



X X 



&UH 3 



8 ft 3 
3 O o 



"3 

§ 



I o ^ 
- ^ 



g 0.2-3 r &8 “ . 
g &'o 8 g'=^-- 

'' ■■ 2 2 'SB 
Sx'^ > 

o O.p 

'^75 2 ^ 

>>fa-S p 

&8^ift:^-g*3 

gg'^-s - 



p i3 



'i>X P O’ 
> o.fa R 



-fa 
g S'S 

'E '^.2 

3 CO 3 

'-' B c« 
O O ft 

8 S S 

® 8ft 



o g 



B 3 co > 
ft g 



§c2 



R 3 

.2 g.„ 

-2.N o 
'—•'go 

M o — 

=« 8 B 

o ft 3 
• o 



'-'ft 

3ft 



S'- T ft o S’ 
3-23 o'^B) ft) 



2 ' 

gS 8 B 

o 



'>5 X 

C1h"75'^ 75 
^ (U^ 



^|gB 



3 ft 3 o 
u © oX 
2 X 



p 



p ^ 



o> 

fa 15 p ^ 
bp P'^ -P P 

p.fa o o 15 

’S2 P 
P P bX) 



i P'^-faxX 

’ (-5 oX X • — 



&Oh^ p.fa ^.2 o b o 

J? S ^ S’^ S'S 

>^X<.fa— o£ppgo 
o^P^XPlZX 

-|'g^ 2 § 0 -Sg-g^ 8 g? 
^3l2s3g|3|SS§ 



P 

o 

: b 5 



s §. 2 B-a'£'S-§ 3^ =5 

P o X fa o 
•r:^ faXcO XX 

R. 2 -" o g,=« 

2 P >, O ^ 



P ^ 
o 



. 2 X 4 - Q Q 

283 8.8' 

3 S-^ft-g o 
|ftftH o 

•" ft "* CO o'-g ^-i 

gB 8 ft'" Oft o'""® 
■ Rft 2 § m3^B 2 2 
.2 0 0 - sB *- S 2 « 
... oc«'«5§H-32ft3 
^.S ^ >,ftD- 3 ft ft 3 § 

^ p fa P p ox fa-fa 

B 8 oB 0.2 ft gft gB 3 
3gBp3||-a|"3 

•ftro ““.2 3^ > &' 2 ft'g 

Bl- 2 . 2 BS?B^ftH.o 

>.3B'2'§1'^'C ftag^o 2 

=iB 2ft|ft'3.2 

.fa75XXP*©Xfa'' ' 



P ^ 
_o 

'fa p 
-2 p 



3-2 o 

O O 3 



2 o 



§. 



o 

0 p’p 
o ' 



^ ,= 
p p . 

■ O- 



p p 



'n ^ p 
2 o o o 

aii'i 

f 2 S’OhS 



o> 

a 

p 

IX 



8 

X 

P 



P 

§ 15 
© 
§x 

Piix 



< 

tyi 

O 






36 MANY VISIONS, MANY AIMS 

Broad Similarities in Science Education 

While differences clearly existed in the educational system structures and practices of 
TIMSS countries, it is equally clear — and equally important — that broad similarities were 
also present across countries. Out of the possible similarities, we focus on two here. 

Required Science Instruction 

All the TIMSS countries required some science instmction in both primary and secondary 
school. The amount of science covered at any given grade varied, especially in the first ele- 
mentary grades, but the constant across all countries was that some science was always required. 
Some countries focused on fewer topics at a time, others on more. Using the most detailed cate- 
gories from the TIMSS science framework as a list of possible topics, the number of science top- 
ics intended to be introduced by the end of secondary school ranged from 38 to 78. 

Beginning in lower secondary school, the situation is quite complex when considering the 
number and type of courses in which these topics are covered. Although every country partic- 
ipating requires science at this level, approximately 60 percent require more than one course — 
each in a separate scientific discipline or set of disciplines. Thus, some countries require a 
course in biology and another in physics. Others have a combined biology/earth sciences 
course and a course in physical sciences that combines both chemistry and physics. Still oth- 
ers intend science to be taught in courses called orienteering and anthropology, or even present 
considerable amount of earth sciences topics in geography, history, or social studies courses. 
The remaining countries require an integrated science course, but the disciplines represented in 
the content of these courses can vary substantially from country to country. 

Reform in Science Education 

Among the TIMSS countries, there was a widespread interest in reform of science education: 
many reforms and managed changes were taking place in science content, pedagogy, and tech- 
nology use. TIMSS surveyed panels of experts in each participating country concerning ongo- 
ing reforms in their countries — both recent and projected near-term reforms. Table 3.3 sum- 
marizes these comments on science education reform initiatives for selected countries. (This 
information may be found in table 1.3 in appendix I for all countries that provided such data.) 

Common themes emerged among these reforms. One was the importance of teaching sci- 
ence in the context of everyday applications. Common justifications argued for deeper student 
engagement and greater utility of the science taught. Denmark, France, Japan, the United 
States, and Australia were among the countries reporting reform efforts oriented toward appli- 
cations and meaningful real-world activities. How extensively these goals had been imple- 
mented at the time of the survey varied greatly. Some countries even looked to TIMSS for 
information on how far such reform had progressed. 

New technologies were influencing thinking about science curricula. Many TIMSS coun- 
tries reported encouraging calculator use in teaching and learning science in secondary schools. 
Australia, the Czech Republic, and the United States reported such reforms; some countries 
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reported beginning to permit ealeulator use on national seienee examinations. Seienee eurrie- 
ula were also reported to be influeneed by reeent advanees in eomputers and software. 

Other eountries reported adding topies or inereasing emphasis on eeology, pollution, and the 
environment. The People’s Republie of China, Japan, the Russian Federation, Belgium (both 
systems), and others reported sueh ehanges in the natural seienees eurrieulum. Some eountries, 
sueh as Bulgaria, reported experimentation with teaehing integrated seienee in lower seeondary 
sehool, moving away from a tradition of separate eourses in the seienees. 

Notably, only one eountry, Japan, reported a reduction in the hours devoted to seienee 
instmetion. This seems to be a reform that eontradiets trends prevailing in most other eountries 
partieipating in TIMSS. 

Differences in the Details of Science Education 

Organization and Numbers of Science Courses 

The order and number of seienee eourses offered in TIMSS eountries varied substantially. 
Although there was eonsiderable variation, almost 60 pereent of the TIMSS eountries offered 
more than one seienee eourse in the upper grade of Population 2, and 5 1 pereent offered three 
or more eourses at this grade. 

Differenees in how seienee was taught in grade 10 in New Zealand, Colombia, and 
Hungary illustrate the variation aeross eountries. Grade 10 was the seeond year of seeondary 
sehool in New Zealand and the modal age of students was 14. Grade 10 was the first year of 
the upper seeondary sequenee in Colombia and the modal age of students was 15. In Hungary, 
students in grade 10 were in their seeond year of upper seeondary sehool and the modal age 
also was 15. 

Only one seienee eourse was offered in grade 10 in New Zealand. This general seienee 
eourse eovered a variety of topies in the physieal and natural seienees; all students at this grade 
level were enrolled. The number and length of periods for whieh this eourse met varied from 
sehool to sehool. As noted earlier, less than half of the TIMSS eountries offered only one inte- 
grated seienee eourse at this grade level. 

In Colombia, grade 10 was the first in whieh the seienees were taught in different eourses 
aeeording to diseipline. One eourse was offered in physies, another in ehemistry. Students 
were required to take both eourses, and 100 pereent of students at this grade level are enrolled 
in eaeh. The physies eourse eovered mostly topies in energy and physieal proeesses as well as 
related topies in teehnology. The ehemistry eourse eovered topies regarding matter and its 
physieal and ehemieal properties, strueture, and ehemieal transformations. Both of these eours- 
es met for two to four 60-minute periods per week. 

Hungary has several grade 10 seienee eourses. All grade 10 students were in the seeond 
year of their 2-year seeondary geography and ehemistry eourses, both of whieh met for about 
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three 45-minute periods per week. They also were in their seeond year of a 4-year eourse enti- 
tled “Seeondary Physies” that also met for two to three 45 -minute periods a week. In addition, 
50 pereent of these students were enrolled in at least one 3-year optional eourse in either biol- 
ogy, physies, geography, or ehemistry, whieh met for three to four periods a week. 

These eourses met for different amounts of time the eontent varied, and eourse goals var- 
ied. Students, instruetional resourees, and teaehing personnel were organized differently. 
Obviously, seienee meant different things to grade 10 students in these three eountries. 

This variety of eourses in many eountries — eaeh often with its own textbooks and guides 
— presented a ehallenge to the eolleetion of data on the seienee eurrieulum. All eourses 
intending instruetion of topies in the TIMSS seienee frameworks were ineluded in all data eol- 
leetions on topie eoverage, textbooks and guides. For some eountries this meant the materials 
for eourses with titles sueh as geography, anthropology, history of the fatherland, or orien- 
teering were ineluded. 

Curriculum Guides and their Use 

Virtually all edueational systems use some form of eurrieulum guide to strueture seienee 
edueation. These guides set forth the system’s goal for its seienee edueation. Countries differ 
widely in the strueture and details of their guides and in how they are meant to be used. 

Currieulum guides serve many purposes. They may speeify aims and objeetives, set out 
polieies, identify eontent to be eovered, suggest teaehing or testing strategies, or present exam- 
ples to guide teaehers. One broad measure for gauging the various purposes of eountries’ eur- 
rieulum guides is page length. Among TIMSS eountries, the page length for eurrieulum guides 
for the upper grade of Population 2 varied from less than 10 pages to hundreds of pages. Even 
after adjusting for differing page dimensions, this is still a signifieant variation. It indieates dif- 
ferenees in guides’ level of detail, and likely refleets differenees in intended use. 

A more refined indieator for identifying eurrieulum guide purpose is to determine the per- 
eentage of eaeh guide devoted to shaping speeifie aspeets of the seienee eurrieulum. Eaeh text 
bloek of eaeh guide was eoded to indieate whether it addressed an aspeet of the TIMSS seienee 
framework. Bloeks that reeeived no eodes were probably those that made general suggestions 
or set out polieies. This approaeh eompensates somewhat for the extensive variation in the sizes 
of sampled eurrieulum guides — bloek percentages are relatively stable and eharaeteristie of 
the guide, regardless of numbers of bloeks eontained. 

More than half of the guides had one framework eode (see explanation in appendix C) for 
more than 90 pereent of their bloeks. Only two eountries had less than 70 pereent: leeland and 
Seotland. This high level of eontent speeifieation seems to have been independent of the length 
of the guides. 
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Textbooks and Their Use 

Pedagogical strategies and approaches vary among countries even when similar science 
content is being presented. That point is driven home by examining textbook data: the lengths 
vary, the sizes vary, the formats vary, and the levels of decoration vary. A scatterplot of text- 
book size (that is, page length times width in square centimeters) versus the length (number of 
pages) would show that textbooks came in virtually every combination. The one comparative- 
ly rare pattern was small books with few pages. The largest books had more than three times 
the page area of the smallest. The longest were six and seven times the length of the shortest. 
Overall, variation was considerable and almost random. 

Some countries, notably the United States and Canada, placed enormous books in students’ 
hands. Other countries, such as Scotland and Iceland, offered their students relatively slim vol- 
umes. Such extensive variation suggests that the books probably were meant to be used in dif- 
ferent ways. A small or slim book might contain only exercises or exposition, but likely was 
not meant to be used independently of the teacher. On the other hand, a larger text probably 
contains a greater range of materials (both exposition and exercises) and may have played a 
larger role in classroom instruction. 

One way to delineate differences in book structure and emphasis is to look at the percent- 
ages of different block types. These block types, as discussed in chapter 1, include narrative 
(exposition and explanation), graphics, exercises, activities, and worked examples. ^ If one 
country’s science textbooks contained a comparatively higher proportion of one block type — 
for example, activities — than did textbooks from another country, it is likely that different 
approaches were used in presenting content in the textbooks, and possibly textbooks were used 
in different ways in the classrooms. (It is important to note that countries were required to ana- 
lyze any separate laboratory manuals that were a required part of science instruction, in addi- 
tion to analyzing textbooks.) 

Figure 3.1 presents the percentages of major block types within the science textbooks for 
the upper grade of Population 2 for all TIMSS countries. Countries clearly varied in the ways 
in which they structured science textbooks. Some depended more heavily on narration, with or 
without graphics (for example, French- and Flemish-speaking Belgium, Iran, and Italy). Some 
textbooks made at least moderate use of activities (for example, Germany and Denmark), and 
even more made use of graphical material (for example, Portugal, Iran, and the Russian 
Federation). 

Science Content Areas and Performance Expectations 

Each national education system pursued broad topic areas of science that reflected their 
national vision and aims for science education. These areas and emphases differed among 
countries — even at the broadest content category level. 

Figure 3.2 presents for the upper grade of Population 2 in selected TIMSS countries the per- 
centage of science textbook blocks allocated to the eight broadest content categories from the 
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Figure 3.1 

Distribution of Block Types in Science Textbooks. 

The percentages of selected block types are given for science textbooks for the upper grade of Population 2. 
The textbooks certainly differed in what they presented and, consequently, in how they might be used. 
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Figure 3.2 

Textbook Space Devoted to Major Science Topics. 

This figure shows the percentages of textbook blocks devoted to the eight broadest science framework content 
categories for the textbooks of the upper grade of Population 2 in a representative selection of countries. This 
shows patterns of varying emphasis that held true for other countries and grades. 
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Figure 3.3 

Textbook Space Devoted to Major Performance Expectations for Selected Countries. 

These data are similar to those of figure 3.2, but for the broadest performance expectation categories. They also 
reveal considerable variation. 
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TIMSS science framework (see appendix I, figure 13.2 for all countries). These data show the 
relative emphases on different science content topics as indicated by space devoted to each.^ 

Figure 3.2 reveals considerable differences in the emphasis on various broad science topics. 
Some books devoted half or more of their blocks to ‘life sciences’ (for example, Iceland and 
Tunisia), while others devoted less than 10 percent (for example, Latvia and Denmark devoted 
3 percent). As the figure shows, almost all topics received considerably varying emphases 
among the countries. ‘Earth sciences’ ranged from 0 percent (Iran, Israel, the Russian 
Federation, and Bulgaria) to 51 to 60 percent (South Africa); ‘physical sciences’ ranged from 0 
percent (Tunisia) to between 81 to 90 percent (Latvia). These data can also be used to indicate 
the topics emphasized by a country’s textbooks. For example, Iceland emphasized ‘life sci- 
ences’ over ‘physical sciences’ and ‘earth sciences,’ whereas other countries have textbooks that 
divide their coverage quite evenly among earth, life, and physical sciences (such as Hong 
Kong). Another pattern was one of divided emphasis between the two disciplines of earth and 
physical sciences with little coverage of life sciences, as is true for the textbooks of the Czech 
Republic and France. Many countries concentrate mostly on the physical sciences (Austria, 
Cyprus, Latvia, etc.); less frequent was a concentration on life sciences (Iceland, Norway, 
Tunisia). 

Textbook data can also be examined for their student performance expectations. Figure 3.3 
presents, for selected countries (see appendix I, figure 13.3 for all countries), the percentage of 
the upper grade of the Population 2 science textbook blocks devoted to the highest level per- 
formance categories from the science framework. These categories — ‘understanding,’ 
‘theorizing, analyzing and solving problems,’ ‘using tools, routine procedures and science 
processes,’ ‘investigating the natural world,’ and ‘communicating’ — represent major types of 
performances that might be expected from students in learning and doing science. 
‘Investigating the natural world’ expectations ranged from 0 percent (six countries) to 21 to 30 
percent (New Zealand). ‘Theorizing, analyzing and solving problems’ expectations ranged 
from 0 percent (Iran and Scotland) to some countries that had between 1 1 and 20 percent (such 
as Korea and Spain). ‘Using tools, routine procedures and science processes’ expectations 
ranged from 31 to 40 percent (Germany) to 0 percent (Colombia). Expectations for ‘investi- 
gating the natural world’ were quite uncommon, with many countries reporting less than 10 per- 
cent of blocks. ‘Communicating’ was the least common expectation, with a large number of 
countries reporting no blocks with this performance expectation. From this table it is clear that 
the most common performance expectation is ‘understanding,’ with some countries (such as 
Scotland and Iceland) focusing on this expectation almost exclusively. The notable exceptions 
are countries that, while still emphasizing ‘understanding,’ have a significant minority of blocks 
devoted to ‘using routine procedures’ (such as Germany, New Zealand, and Hong Kong) and 
‘theorizing, analyzing, and solving problems’ (such as Korea and Spain). 
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Science Topic Sequences 

The sequence in which various science topics are presented varied by country. The com- 
bined influences of different educational system stmctures, science content emphases, and per- 
formance expectations across topics yielded varied patterns of topic coverage over the years of 
schooling. Figure 3.4 presents comparative data for two countries — the People’s Republic of 
China and Iceland — across the range of grades for four topics from the science framework. In 
Iceland, the topic ‘planets in the solar system’ was introduced when students were age 13 and 
emphasized when they were age 14. At age 14, the topic of ‘beyond the solar system’ was 
introduced and studied until the end of upper secondary school. In the People’s Republic of 
China, both topics receive focused instruction when students are age 16. In the People’s 
Republic of China, both ‘variation and inheritance’ as well as ‘evolution, speciation, diversity’ 
are taught over a four-year period beginning at age 14. In Iceland, more years are devoted to 
these topics beginning at ages 14 and 13, respectively. 

Do Common Visions and Aims Exist? 

This chapter has emphasized that educational systems differ markedly in the years in which 
schooling begins, the years of schooling provided, the years of compulsory schooling, and in 
how the grades are clustered. Countries differed in the level at which decisions were made, in 
how complex the internal structure of the educational system was, and in what types of deci- 
sions were made at different levels. Broad similarities existed in that virtually all countries 
required science instruction and that many of the general topics were common among countries. 
When we examined details, however, we found that curriculum guides varied in structure and 
use, as did textbooks, content sequences, science content areas, and performance expectations 
— both globally and within any given topic. 

If commonalties existed only at the broadest levels, is there any point in seeking meaning- 
ful common visions and aims by which countries can learn from mutual benchmarking and 
cross-national comparisons? This remains an empirical question — and one which in part this 
volume is devoted to answering. Clearly, flexibility must exist in seeking the bases for com- 
parisons. Commonalities can be seen in some features but not in others, and how critical these 
features will be remains to be seen. When commonalities are sought among smaller sets of peer 
nations, rather than in the full set of TIMSS countries, stronger similarities may be identified. 
The remainder of this volume is devoted to setting out some of the many, complex commonal- 
ties and differences about science curricula examined through the methods sketched earlier and 
setting the stage of varied practice across the TIMSS countries. 
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Figure 3.4 

Comparative Sequences in Four Science Topics for the People's Republic of China and Iceland. 

Focusing only on two countries and four topics shows that the sequence of covering aspects of topics varied as 
well as did overall emphasis. 
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Notes 

‘ The ‘baccalaureate’ is a special diploma awarded in France based on a student’s perfor- 
mance on a set of examinations taken in the final year of secondary school. Possession of 
this diploma is required to be eligible for admission to a university. 

2 Detailed explanation of blocks and block types can be found in appendix E. 

3 Textbook emphasis data have certain intrinsic weaknesses. For one, they do not neces- 
sarily reflect official curricular intentions in some countries. Additionally, many parts of 
science textbooks may never have been covered; conversely, there may well have been 
topics emphasized in class that were not reflected by the space accorded in textbooks. 
Generally, however, content emphases in textbooks tend to indicate the content that is 
most likely covered. 
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Chapter 4 

Curriculum Guides: Directing Curriculum by 
Intention 

A group sponsored by a ministry of education meets. Their task is to revise, 
reform, and renew the science curriculum for public lower secondary schools. 

The group includes ministry representatives, some scientists and science cur- 
riculum specialists from universities, and a few science teachers from lower sec- 
ondary schools. They talk; they review the current curriculum; they argue. In 
time, a new vision begins to emerge, a goals statement is drafted that makes that 
vision specific, and plans are drawn for a new science curriculum. 

In the same country, a group of teachers meet to plan science instruction in their 
grade of lower secondary school for the coming year. They talk; they review 
documents from the education ministry that are to guide the course of study they 
will provide; they argue. Their plans emerge. They begin to prepare specifi- 
cally for day-to-day science instruction. 

Later a group of science students sit in the classes of one of these teachers. They 
listen; they think; they work on assigned tasks; they argue with each other. The 
teacher’s plans change in small ways — as always when faced with an actual class 

— but mostly she acts according to the plans she made earlier and discussed with 
her colleagues. The vision of science instruction in her head — and in her plans 

— is played out in dozens of small scenes with the students in her classroom. 

What connects these three groups — eurrieulum planners, seienee teaehers, and students — is 
a curriculum guide. ‘ Aetivities follow from eurrieulum planners’ ideas, they guide teaehers’ 
work, and shape students’ efforts. 

A eurrieulum guide is, in most eountries, the main doeument for offieially setting out a eur- 
rieulum. Guides eome in many forms, but they all serve several important funetions. They rep- 
resent offieially sanetioned deeisions, set out polieies related to a speeifie eurrieulum and its 
implementation, address those who will implement eurrieulum (sehool offieials, teaehers, ete.), 
and state aims and goals. These doeuments also may try to eonvey the vision lying behind the 
speeifie goals and requirements of a partieular eurrieulum. 
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At their most detailed, they eontain suggestions and even examples of teaehing strategies 
and, perhaps, testing strategies as well. Often, they eontain detailed eontent speeifieations and 
eontent sequenees to be eovered. They are the link between eurrieulum planners’ intentions and 
implementations of seienee eurrieula. In faet, eurrieulum guides are one of the primary means 
by whieh the planners eommunieate with the implementors and have an impaet on their aetions. 

On the other hand, although eurrieulum guides are important and serve a roughly similar 
funetion for national edueational systems, they are also quite varied. This ehapter uses TIMSS 
sampled eurrieulum guides to present some of the eommon features and variations in these em- 
eial eurrieular doeuments. 

Authority and Function 

Currieulum guides published by national or sub-national governmental bodies existed in all 
TIMSS eountries exeept Iran. The guides all earried at least some offieial status, although sta- 
tus and authority varied among eountries and often within a eountry for sub-national or region- 
al guides. Loeal guides — for example, for a sehool or a group of sehools — were also often 
available, but sueh guides typieally interpreted national goals stated in other doeuments, with 
the aim of ensuring uniformity and elarity in the loeal implementation of the eurrieulum. 

The pereeived signifieanee varied substantially by eountry. Currieulum guides in Australia, 
for example, had sueh titles as “Course Adviee,” whereas in Japan they were known as 
“National Courses of Study” and in Ontario, Canada, as “the Common Currieulum.” These 
diverse titles suggest different offieial statuses and funetions. Some guides speeified the eours- 
es of study for whieh teaehers were responsible. Others speeified how teaehers might pursue 
their goals, as well as what types of instruetional methods and assessment strategies might be 
appropriate. Still others left most implementation details to teaehers and attempted to aeeom- 
plish their purpose solely by stating shared objeetives. 

Grade Spans Covered by Curriculum Guides 

Some eountries had long eurrieulum guides that eovered numerous grades; others had 
shorter, more speeifieally targeted guides. If one foeuses on a sample of eurrieulum guides 
that inelude students at age 13, the defining age for TIMSS Population 2, to determine the span 
(number of grades, that ean also be expressed as the range of ages) eovered by eaeh guide, the 
eurrieulum guides that ineluded 13-year-old students would be seen to have ranged from those 
that eovered only one age to those that eovered grades for a span of 14 years. There was eon- 
siderable variation among eountries in the span of years eovered, and even eonsiderable vari- 
ation within eountries. Eighteen eountries had more than one guide sampled for age 13. The 
differenees between the least and most inelusive varied from 0 to 12 (United States) or 9 
(Seotland) years differenee. Guides also differed in how age 13 was grouped with other ages. 
In some eases it was eonsidered alone or with a few other ages; in others was plaeed near the 
end of a longer span eovering lower grades; in still others, it was plaeed near the beginning of 
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a span covering higher grades; occasionally, it was near the middle of a guide that spanned vir- 
tually all years. 

A eloser look reveals other patterns among the sampled guides. Five of the sampled eur- 
rieulum guides were speeifie to age 13, the target age for Population 2. Another 12 guides eov- 
ered only 2 years. Of those eovering 2 years, there were three guides for whieh age 13 is the 
upper age of the span and eight guides for whieh it is the lower. Eight other eountries had 
guides that spanned 3 years — and in five guides, age 13 was the middle of the 3 ages spanned. 
In three guides, age 13 was at the beginning of the three ages spanned. In another 10 eases, four 
grades were spanned, with both the guides sampled for the Slovak Republie being of this type. 
In another four eases, five ages were spanned, and in another three eases, six or seven ages were 
spanned. 

Finally, other guides eovered 8 to 14 years, thus spanning most of the ages for formal 
sehooling. In all of these guides, age 13 was one of the later ages ineluded — again suggest- 
ing this age was grouped with seeondary sehooling. Although sampling prevents drawing a 
firm eonelusion, it is worth noting that many longer span guides were from either the United 
States or eountries in the British Commonwealth tradition — Australia, Canada, Seotland, and 
New Zealand. 

Structure of Curriculum Guides 

From the sampled doeuments, it appears that seienee eurrieulum guides vary in the strate- 
gy they take to set forth and shape eurrieulum. Speeifieally, some tend to be more prescriptive 
than others: these state polieies, formal objeetives for seienee instruetions, and so on. Others 
tend to be more facilitative; they inelude sueh information as suggested strategies for teaehers, 
examples, and assessment ideas. 

Types of Units 

The doeument analysis methodology for eurrieulum guides has the ability to eapture some- 
thing of this range from preseriptive to faeilitative. Currieulum guides were divided into sev- 
eral types of units. 

• Policy units were limited to those that stated formal polieies about seienee eurrieulum 
and instruetion, other than speeifieations of eontent or eurrieular objeetives. 

• Objective units were mainly formal statements of objeetives for seienee eurrieulum and 
instruetion. These units typieally ineluded diseussion of the seienee eontent involved, 
what students were expeeted to be able to do when this eontent was mastered at the level 
desired, or both. 

• Content units were limited to stating speeifie seienee eontents to be eovered when eon- 
tents were not stated as part of the instruetional objeetives. In some eases, this infor- 
mation ineluded the relative amounts of emphasis or instruetional time alloeated to 
those eontents. 
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• Pedagogical units included material that made pedagogical suggestions — for example, 
strategies that might be used to obtain a partieular objeetive or to eover speeifie seienee 
eontents. These units also ineluded examples given of pedagogieal approaehes, demon- 
stration problems, ete., as well as speeifie information or examples given about the most 
effeetive ways to assess mastery of partieular seienee eontents and attainment of partie- 
ular goals. If, however, the material was aetually a poliey preseribing standards or pro- 
eedures for assessing and grading student work, it was elassified as part of a poliey unit 
rather than as part of a unit of pedagogy. 

These unit types — introduetion, poliey, objeetive, eontent, pedagogy, and others — were 
designed to provide insight into the approaeh of eaeh guide. The introduetion and other units 
were eonsidered neutral in or irrelevant to eharaeterizing the approaeh of eurrieulum guides; the 
poliey, objeetive, and eontent units were more direetive and preseriptive as ways of guiding eur- 
rieulum; and the pedagogy units presented a more faeilitative approaeh to eurrieulum. 

Figure 4.1 displays the pereentage of pages^ for eaeh of the eurrieulum guide unit types for 
the Population 1 seienee eurrieulum guides in the TIMSS eountries with the highest pereent- 
ages for eaeh of the unit types — espeeially poliey, eontent, objeetives, and pedagogieal sug- 
gestions. 

As shown in figure 4.1, eontent units were present in most Population 1 seienee eurrieulum 
guides. Flemish-speaking Belgium, Sweden, Romania, and the Russian Federation are among 
the eountries with more than 60 pereent of their pages given to eontent units. Pedagogy units 
formed more than 40 pereent of the material in the eurrieulum guides of Freneh-speaking 
Belgium and Israel. Poliey units were less eommon — sueh units were absent from the eur- 
rieulum guides of more than one-half of the eountries. Norway is an important exeeption, with 
more than 40 pereent of the pages being devoted to poliey units. Many eountries devoted mueh 
larger proportions of their guides to objeetive units. Spain and Mexieo were remarkable in 
devoting more than 75 pereent of the pages in their Population 1 seienee guides to units express- 
ing instruetional objeetives. 

Poliey, objeetive, and eontent units represent a preseriptive approaeh to setting out eurrieu- 
lum. Aggregating these data shows that some eountries took this approaeh almost entirely. For 
example, more than 70 pereent of the seienee eurrieulum guide pages were devoted to one or 
more of these three types of units in several eountries — Flemish-speaking Belgium, Hungary, 
Franee, Ireland, Japan, Romania, Seotland, Sweden, Spain, and Norway. This suggests that 
many eountries took a more preseriptive approaeh to eommunieating eurrieular intentions and 
shaping the implementation of Population 1 seienee eurrieula. This does not, however, take into 
aeeount the possible existenee of separate pedagogieal doeuments in some eountries that were 
not analyzed. 

In eontrast, few eountries devoted a eonsiderable number of pages to pedagogieal sugges- 
tions. Israel, however, devoted more than one-half of its eurrieulum guide to pedagogieal sug- 
gestion units. A few eountries used a strong supplement of pedagogieal suggestions to support 




higher percentages of pedagogy units. 
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Missing Data: Argentina, Bulgaria, People's Republic of Chino, Cyprus, Denmark, Germany, Iran (no curriculum guides exist), Italy, Lithuania, Philippines, and Tunisia. 
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Other, more preseriptive unit types. Korea and Freneh-speaking Belgium appear to exemplify 
use of this eombined preseriptive-faeilitative approaeh. 

Population 1 data were shown in figure 4.1 beeause it seemed a reasonable assumption that 
the most use of pedagogieal faeilitation (and proportionately less use of more preseriptive 
approaehes) would be found at this population eoneerning seienee eurrieula for the youngest 
students targeted by TIMSS. Clearly, this assumption was not supported by the data. The same 
patterns of varied uses of more preseriptive approaehes were seen in Population 2 guides. 
Comparatively less spaee was given to pedagogieal support in the Population 1 materials of 
many eountries. However, in a few eases — for example, the Dominiean Republie and Korea 
— more than 40 pereent of the Population 2 seienee guide pages were devoted to pedagogieal 
suggestions. Flemish-speaking Belgium was the most anomalous ease, with no pages devoted 
to pedagogieal suggestions at Population 1 and more than 35 pereent at Population 2. In 
Population 3, eurrieula — physies for advaneed, speeialist students — were eonsistently 
approaehed in a less preseriptive way. In several eountries, however, sueh as Spain, Korea and 
Denmark, more than 40 pereent of advaneed seienee eurrieulum guide pages were devoted to 
pedagogieal suggestions. 

It appears likely that Population 1 seienee eurrieula were generally treated as eomparative- 
ly less eomplex and less in need of formal pedagogieal support in eurrieulum guides than was 
the more eomplex and diffieult-to-teaeh material for Population 2. 

What is apparent, however, is that a variety of approaehes were taken to eommunieating and 
shaping eurrieular intentions in eurrieulum guides at every eurrieulum level and that, in most 
eases, these approaehes tended to the more preseriptive and direetive in Population 1. The 
amounts of spaee devoted to pedagogieal support varied interestingly among the eountries and 
the student populations. Clearly this matter of the strategy for setting out seienee eurrieula in 
eurrieulum guides is a subjeet worthy of further inquiry. 

Type of Blocks 

Data are available to take a more fine-grained look at the strueture and strategy of present- 
ing eurrieulum in guides. Beeause the eurrieulum guides were not tied to alloeated time or any 
other uniform indieator, we eould not identify relative emphases of the guides at the unit level. 
Instead, in our analysis of eurrieulum guides, we sub-divided eaeh unit into bloeks. Seven dif- 
ferent bloek types were used — poliey statement, single objeetive, single eontent speeifieations 
(element), pedagogieal suggestions, example (as part of a suggested pedagogieal approaeh), 
assessment suggestion, and other. Although these bloeks varied eonsiderably in size, and thus 
in the amount of emphasis indieated, they did provide us with further detail on and insight into 
the stmeture and use of eurrieulum guides. Figure 4.2 displays the variation aeross TIMSS 
eountries in the use of different types of bloeks in the eurrieulum guides of the upper grade of 
Population 2, whieh are similar to that noted for unit types in Population 1 . 




Figure 4.2 

Proportions of Different Block Types in Population 2. 

This figure presents science curriculum guide block type percentages. 
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Figure 4.3 demonstrates the variation within pedagogy units. Included in this analysis are 
all those TIMSS countries that used more than 25 percent pedagogical suggestion units for their 
Population 2 science curriculum guides and that also had at least 20 blocks in the pool of their 
pedagogical suggestion units. Of these countries, several showed 100 percent consistency in 
using pedagogical suggestion blocks within pedagogical suggestion units. Only eight countries 
had an agreement of 50 percent or less: New Zealand, Singapore, Scotland, the Russian 

Federation, France, French-speaking Belgium, Hong Kong, and Iceland. They complemented 
the pedagogical suggestion blocks in the pedagogical suggestion units in varying ways: with 
example blocks in the case of the Russian Federation and Iceland, and a sizable proportion of 
assessment suggestions in Singapore and New Zealand. 

The strategy of providing pedagogical support and facilitation obviously was not simple. 
Some countries, such as Japan and Israel, did not mix them with other unit types. Others, for 
example, Hungary, included a sizable proportion of examples. 

Science Content Specified in Curricnlum Gnides 

A fundamental question about the science curriculum guides sampled was to what extent 
specific science contents were included in those guides. 

Inclusion of Science Content 

Whether science content was specified varied for different block types. For each popula- 
tion, about one-half of the blocks in introductory and policy units had science codes. In the case 
of advanced physics, slightly less than one-half the blocks in introductory material had science 
content specified. However, for objective and content units, 95 percent or more of the blocks 
had science codes in all three populations. For pedagogy units, from about 80 to slightly less 
than 90 percent of the blocks had science content codes. The percentage was also high for other 
units. 

Overall, the science curriculum guides specified science content with great frequency. This, 
unexpectedly, was less true in introductory and general policy units. Science content was 
almost always specified in objective and content units — as would be expected in documents 
for communicating science curricular goals. Pedagogical suggestions may vary from more gen- 
eral strategies and approaches to those that are specific to particular science contents. In the 
sampled guides, it is apparent that the focus was much more on particular, topic-specific peda- 
gogical comments rather than more general comments — although some of the latter were 
clearly made. There was some variation among countries, but what was true overall was 
largely tme for most countries individually. These were indeed and specifically science guides 
— and not general documents about curriculum. 
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Figure 4.3 

Pedagogical Blocks within Pedagogy Units. 

These are the percentages of the three types of pedagogy blocks within the pool of blocks from pedagogy units 
for a representative sample of countries and science guides for the upper grade of Population 2. The structure of 
pedagogy units were varied in many countries. 
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Specificity of Science Content 

The sampled eurrieulum guides were largely devoted to eommunieation about seienee top- 
ies. But how broadly or narrowly did they speeify the seienee eontent and objeetives? Did they 
provide broad, general goals and seienee eontent areas or mueh more speeifie instruetional 
objeetives and very preeise speeifieations of seienee eontent areas? Did eurrieulum guides vary 
greatly in their degree of speeifieity or are there typieally patterns with less varianee? 

The somewhat hierarehieal stmeture of the TIMSS seienee framework provides one way of 
assessing how preeisely eontent is speeified in seienee eurrieulum guides. At the most general 
level, the seienee framework has eight broad eategories — Earth Seienees; Life Seienees; 
Physieal Seienees; Seienee, Teehnology, and Mathematies; History of Seienee and Teehnology; 
Environmental and Resouree Issues; Nature of Seienee; and Seienee and Other Diseiplines. 
Within eaeh of these broad eategories is a set of more speeifie eategories, and some of these 
eontain a third, even more speeifie eontent level. 

In the TIMSS eurrieulum analysis, eoders indieated eontent eodes at the most speeifie level 
possible — that is, they provided eodes at the lowest possible level at whieh the speeifieity was 
unambiguously supported by the aetual wording of the doeument, not inferred from the word- 
ing or assumed from knowledge not aetually in the doeument. How preeisely eontent was spee- 
ified gives an indieation of how direetive the eurrieulum guides were. A higher pereentage of 
more speeifie eodes assigned would indieate a more preeise speeifieation of seienee eontent; 
this in turn would indieate that the eurrieulum guides refleeted a more mieromanaged eommu- 
nieation of eurrieular intentions and guidanee of implementation. 

Similarly, the student performanee expeetation aspeet of the seienee framework eonsisted 
of a set of more global eategories, nested within whieh is a seeond level of more speeifie eate- 
gories. The instruetions for eoding speeifieally were the same as those for seienee eontent. 
Higher pereentages of more detailed eodes would indieate again a tendeney to mieromanage- 
ment. More general eodes would imply less guidanee and preseription from higher levels in the 
edueational system — and greater freedom in implementation at more loeal levels. 

Table 4.1 presents, for seleeted eountries (see appendix I, table 14.1 for all eountries), the 
pereentage of bloeks in all of eaeh eountry’s seienee eurrieulum guides that reeeived at least one 
seienee eontent eode at the most speeifie, middle, and most general levels of the seienee frame- 
work. The table also presents the pereentage of bloeks reeeiving performanee expeetation 
eodes at the more speeifie and more general levels. As ean be observed, eountries varied eon- 
siderably in the speeifieity of the statements eoneerning eontent and performanee expeetations 
in guides. 

Some eountries used the more general eodes in deseribing the performanees expeeted of stu- 
dents. Some eountries — most notably Sweden and Franee for the upper grade of Population 
1 — used mostly general speeifieations for the performanees expeeted of students. The exaet 




Table 4.1 

Specificity of Curriculum Guides. 
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significance of this is not clear. One possibility is that the curriculum guides themselves stated 
expectations for students at a more general level. Another possibility is that the science frame- 
work was inadequate for some countries to characterize their common expectations for students 
except in general terms; but the number of countries that did highly specify performance expec- 
tations suggests that this possibility is not the sole explanation. 

Concluding Remarks 

This chapter has offered an essential first step in the study of science curriculum guides. It 
makes clear that, based on an analysis of the sampled documents, there were considerable cross- 
national variations in the stmcture, specificity, and role of eurrieulum guides. In virtually all 
eases, however, they seem to have been earefully targeted doeuments, often of great speeifiei- 
ty, by whieh eurrieulum designers eommunieated their intentions, espeeially to those shaping 
seienee eurrieula and providing instmetion in aetual elassrooms. 
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Notes 

’ ‘Curriculum guide’ is used here as a generic, standardized term for countries’ official doc- 
uments setting out policies and curricular intentions. They are called by many names in var- 
ious countries - ‘framework’, ‘syllabus’, ‘national curriculum,’ and so on. 

2 The percentage of pages of a certain unit type rather than percentage of total units that were 
of that unit type had to be used for comparison here, even though the curriculum guide page 
sizes differ greatly among the documents, as does the amount of information per page (espe- 
cially when the content of the pages are in different languages). Unit types for curriculum 
guides were not structured to be of comparable sizes as were unit types in textbooks. 
However, using percentage of pages for a given unit type expresses the proportion of a doc- 
ument devoted to a given unit type — that is, it compensates for different page sizes and 
linguistic densities since it compares pages to pages within the same document. 




III. Reflections of Curriculum 
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Chapter 5 

Intended Flow of Science Curricula 

Science curricula “flow” over time. From the beginning of formal schooling to the end, sci- 
ence topics are introduced, receive attention for a time, and then stop receiving instructional 
time. This flow of science topics — those introduced, their duration, their departure — varies 
among countries and curricula, but the flow is planned and purposeful. It results from concep- 
tions of how science should develop over schooling and of aims based on those conceptions. 

A central issue in understanding curricular flow is the determination of whether science 
thinking develops independently of culture. One hypothesis assumes that there is a natural 
sequence to the development of scientific ideas that is linked to stages in human development; 
this sequence — and indeed, these stages — mostly holds true for all individuals and cultures. 
An opposing hypothesis considers science thinking — or any other aspect of thinking — to 
depend on culture. Perceptions, concepts, ways of knowing, and related aspects of thought are 
believed to differ significantly among cultures. The former position assumes a single appro- 
priate sequence of science development that varies only slightly among countries, cultures, and 
languages. These variations represent either different understandings of when children arrive 
at readiness for particular topics or differences introduced accidentally by the decision making 
that creates science curricula and other plans of study. For the latter position, differences among 
countries in when science topics are introduced are far from accidental. The curriculum differ- 
ences reflect important cultural differences as to how scientific thinking develops in a particu- 
lar culture and how scientific knowledge is constructed and reconstructed socially. 

This chapter looks at the differences and similarities across countries in curricular flow. The 
primary data source was judgments by panels of national experts and by ministry officials as 
informed by their country’s curriculum guides. Their judgments concerned which topics in the 
Third International Mathematics and Science Study (TIMSS) science framework received 
attention in which years of science instruction. Appendix D details how they conveyed these 
judgments. As appropriate, experts also provided flow data for each science curriculum imple- 
mented in different regions, tracks, or other subnational segments of a country’s educational 
system. They mapped in the broadest, least detailed sense the flow of educational experiences 
provided by schooling shaped by a nation’s science curricula. 
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Given the wealth of data available for this analysis, a general picture of coverage for each 
science topic in the TIMSS framework is first created. Directing attention to the grade level at 
which a particular topic was introduced reduced but did not eliminate this diversity because 
each topic was introduced in differing grades in various curricula. This is an aggregation prob- 
lem — how can one represent what was broadly common among diverse data yet not do it so 
broadly as to create a false impression? Here something like a median was used — in particu- 
lar, the grade by which half of the TIMSS countries supplying curricular data had introduced a 
particular topic. Some countries will have introduced each such topic earlier, some later — but 
the grade level indicated represents when a topic was most typically introduced. By adding fur- 
ther data on the grade by which one-half of the countries had completed each topic’s coverage, 
one has a broad portrait of how early and how long attention was devoted to each topic in the 
science framework. 

Table 5.1 presents data on typical grades in which science framework topics were intro- 
duced and completed for the aggregate of TIMSS countries. In addition, data are given on the 
grade level at which the majority of all countries that covered a topic focused on the topic. 
These data are presented as if the flow of national curricula for each topic had been superim- 
posed and a rough center for the introduction, conclusion, and focus had been determined. 
What emerges is a commonality — a “skeleton” of approximate similarity — for the place of 
each science topic in the composite flow of science curricula. Only further analyses will reveal 
whether this commonality is significant and substantive — or merely an accident due to the 
aggregation method. 

The grade in which half the countries introduced topics varied from grade 2 to grade 1 1 . 
Topics varied less in the grade by which they were concluded — from grade 10 to grade 12 in 
the aggregate. Obviously this created differences in the typical duration (number of years) to 
which curricular attention was devoted to a topic. 

Introducing Science 

Overall Picture 

The TIMSS science framework offers a norm against which topic introduction can be com- 
pared. The lowest, most detailed levels of the TIMSS science framework orders topics within 
each category based on a priori judgment of approximate increasing difficulty.' The eight most 
general categories of the content aspect of the science framework represent overarching cate- 
gories that organize the more detailed specifications that are possible with their subordinate 
codes. Organizing our conclusions according to these most general categories allows us to 
explore to some degree how various scientific disciplinary areas are intended for instruction. 

• Most topics from the earth and life sciences tend to be introduced somewhere between 
grade 3 and grade 7 — the major exceptions being ‘biochemical processes in cells’ and 
topics in ‘life spirals, genetic continuity, diversity,’ some of which have not been 
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Table 5.1 

Introducing, Focusing On, and Compieting Science Topics. 

There were important differences in the grade at which different science topics were introduced. There were also 
differences in the typical grade for completing topics and for focusing special attention on them. 





Grade level at 


Grade level at 


Grade level at 




which half the 


which the most 


which half the 




countries had 


countries focused 


countries had 




introduced the 


on the topic 


completed the 


Science Topics 


topic 




topic 


Earth Sciences 








Earth Features 








Composition 


5 


10 


11 


Landforms 


4 


7 


10 


Bodies ofWater 


3 


7 


10 


Atmosphere 


5 


7 


11 


Rocks, Soil 


4 


8 


11 


Ice Forms 


7 


8 


12 


Earth Processes 








Weather and Climate 


3 


7 


10 


Physical Cycles 


4 


7 


10 


Building and Breaking 


5 


7 


11 


Earth’s History 


6 


12 


12 


Earth in the Universe 








Earth in the Solar System 


4 


7 


10 


Planets in the Solar System 


5 


9 


11 


Beyond the Solar System 


7 


9 


11 


Evolution of the Universe 


10 


12 


12 


Life Sciences 








Diversity, Organization, Structure of Living Things 








Plants, Fungi 


2 


7 


11 


Animals 


2 


7 


11 


Other Organisms 


6 


7 


12 


Organs, Tissues 


3 


8 


12 


Cells 


6 


10 


12 


Life Processes and Systems EnablingLife Functions 








Energy Handling 


5 


11 


12 


Sensing & Responding 


7 


12 


12 


Biochemical Processes in Cells 


9 


11 


12 


Life Spirals, Genetic Continuity, Diversity 








Life Cycles 


3 


12 


12 


Reproduction 


3 


9 


12 


Variation & Inheritance 


8 


12 


12 


Evolution, Speciation, Diversity 


7 


12 


12 


Biochemistry of Genetics 


10 


12 


12 
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Table 5.1 (continued) 

Introducing, Focusing On, and Completing Science Topics. 



Science Topics 


Grade level at 
which half the 
countries had 
introduced the 
topic 


Grade level at 
which the most 
countries focused 
on the topic 


Grade level at 
which half the 
countries had 
completed the 
topic 


Interactions of Living Things 








Biomes & Ecosystems 


5 


7 


12 


Habitats &Niches 


4 


9 


12 


Interdependence of Life 


4 


8 


12 


Animal Behavior 


3 


7 


11 


Human Biology & Health 








Nutrition 


2 


8 


12 


Disease 


3 


8 


12 


Physical Sciences 
Matter 








Classification of Matter 


5 


10 


11 


Physical Properties 


3 


7 


11 


Chemical Properties 


7 


10 


12 


Structure of Matter 








Atoms, Ions, Molecules 


7 


10 


12 


Macromolecules, Crystals 


9 


11 


12 


Subatomic Particles 


8 


10 


12 


Energy and Physical Processes 








Energy Types, Sources, Conversions 


5 


11 


12 


Heat and Temperature 


4 


10 


11 


Wave Phenomena 


9 


11 


12 


Sound and Vibration 


6 


11 


12 


Light 


5 


12 


12 


Electricity 


5 


11 


12 


Magnetism 


6 


12 


12 


Physical Transformations 








Physical Changes 


4 


10 


12 


Explanations of Physical Changes 


7 


10 


12 


Kinetic Theory 


10 


10 


12 


Quantum Theory & Fundamental Particles 


11 


12 


12 


Chemical Transformations 








Chemical Changes 


7 


9 


12 


Explanations of Chemical Changes 


9 


9 


12 


Rate of Change & Equilibria 


9 


11 


12 


Energy & Chemical Change 


9 


11 


12 


Organic & Biochemical Changes 


9 


11 


12 


Nuclear Chemistry 


10 


12 


12 


Electrochemistry 


9 


10 


12 
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Science Topics 



Forces and Motion 

Types ofForces 
Time, Space, & Motion 
Dynamies ofMotion 
Relativity Theory 
Fluid Behavior 

Science, Technology, and Mathematics 
Natnreor Conceptions of Technology 

Interactions of Science, Mathematics, and Technology 

Influence of Mathematics k Technology in Science 
Science Applications in Mathematics & Technology 

Interactions of Science, Technology, & Society 

Influence of Science & Technology on Society 
Influence of Society on Science, Technology 

History of Science and Technology 

Environmental and Resource Issues 
Pollution 

Conservation ofLand, Water, & Sea Resources 

Conservation of Material & Energy Resources 

WorldPopulation 

Fond Production, Storage 

Effects ofNatural Disasters 

Nature of Science 

Nature of Scientific Knowledge 
The Scientific Enterprise' 

Science and Other Disciplines 
Science & Mathematics 
Science & Other Disciplines' 



Grade level at 


Grade level at 


Grade level at 


which half the 


which the most 


which half the 


countries had 


countries focused 


countries had 


introduced the 


on the topic 


completed the 


topic 




topic 


7 


10 


12 


6 


10 


12 


8 


10 


12 


11 


12 


12 


11 


9 


12 


7 


12 


12 


10 


12 


12 


7 


12 


12 


9 


8 


12 


10 


12 


12 


8 


11 


12 


4 


9 


12 


3 


8 


12 


5 


8 


12 


7 


12 


12 


7 


8 


12 


6 


12 


12 


7 


10 


12 


9 


9 


12 



1 So few countries intended to cover or focus on these topics that reporting any grade level would be misleading. 
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introduced in one-half of the TIMSS countries before grades 9 or 10. In earth science 
the sole exception is ‘evolution of the universe.’ Most topics introduced in grade 3 indi- 
cate an early primary curriculum mostly devoted to the study of taxonomy and weath- 
er. Once introduced, all of the life science topics remain in the curriculum until the end 
of upper secondary. This suggests that while topics are added to the curriculum with 
some regularity, mastery is not assumed until the conclusion of schooling. Perhaps it is 
the case that informal treatment at early grades is followed by formal treatment that con- 
cludes at the end of secondary. 

• This pattern of the persistence of topics throughout the school years is apparently true 

for the physical sciences also. Although, most topics in this area are introduced later 
than was the case for life sciences (in secondary school — grades 7 to 12). They also 
are not instructionally completed in one-half of the countries until upper secondary, 
none before grade 11. This shows notable contrast from the pattern noted in mathe- 
matics curricula, where almost one -half of the topics introduced in primary school are 
completed by the end of lower secondary school. Only three topics are commonly intro- 
duced before grade 5: ‘heat and temperature,’ ‘physical properties of matter,’ and 

‘physical changes.’ 

• Only in the earth sciences are a substantial number of topics concluded by grade 10. 
Most topics are introduced before or at grade 6. A noteworthy exception is the cos- 
mogony topic of ‘evolution of the universe,’ which one-half of the countries have intro- 
duced only by grade 10, perhaps as part of the treatment of astronomy and astrophysics 
in the physical sciences curricula. 



The analysis of topic introduction considered which topics were introduced in the intended 
curriculum, within certain clusters of grades. Table 5.2 presents experts’ judgments of intend- 
ed introduction of science topics in a different arrangement. Here the topics are arranged by 
key groups of grades (that is, grades 1 to 3, grades 4 to 6, grades 7 and 8, and grades 9 to 12). 
While grades 1 to 3 and grades 4 to 6 clearly represented lower and upper elementary school it 
was less clear how — or whether — to separate grades 7 to 12, which generally represent sec- 
ondary school. Grades 7 and 8 were particularly problematic. They are important transition 
grades and were grouped with different higher or lower grades in different countries. Because 
these grades cover the TIMSS targeted Population 2 of 13-year-old students, it was decided to 
designate them as a separate category in this analysis. 

As table 5.2 shows, comparatively fewer topics are covered in the lower primary grades. 
Topics typically intended for introduction in grades 1 to 3 were mostly in life and earth sciences. 
They included a large proportion of topics involving classification, such as ‘animals,’ ‘bodies 
of water,’ ‘plants, fungi,’ and ‘organs, tissues.’ 

More topics were intended for introduction in later elementary school science. In grades 
4 to 6, content in the physical sciences was introduced, centering on topics of classification 
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Table 5.2 

Science Topics Intended for Introdnction in Varions Stages. 

Certain framework topies were typieally introdueed at various stages of sehooling: grades 1 to 3, 4 to 6, 7 to 8, 
9 to 12. This table presents a broad pieture of the typieal sequenee of seienee topies introduetion (representing 
the aggregate and not individual eountries). 



Grade Group 


Topies That Half the Countries Intended for Introduetion in Grade Group 


1 to 3 


Bodies of water 


Reproduction of Organisms 




Weather & climate 


Animal Behavior 




Plants, Fungi 


Nutrition 




Animals 


Physical Properties of Matter 




Organs, Tissues 

Life Cycles of Organisms 


Conservation of Land, Water, & Sea Resources 


4 to 6 


Composition 


Interdependence of Life 




Landforms 


Diseases 




Atmosphere 


Classification of Matter 




Rocks, Soil 


Energy types. Sources, Conversions 




Physical Cycles 


Heat & Temperature 




Building and Breaking 


Sound & Vibration 




Earth’s History 


Light 




Earth in the Solar System 


Electricity 




Planets in the Solar System 


Magnetism 




Other Organisms 


Physical Changes 




Cells 


Time, Space, Motion 




Energy Handling 


Pollution 




Biomes & Ecosystems 


Conservation of Material & Energy Resources 




Habitats & Niches 


Effects of Natural Disasters 


7 to 8 


Ice Forms 


Types of Forces 




Beyond the Solar System 


Dynamics of Motion 




Sensing & Responding 


Nature or Conceptions of Technology 




Variation & Inheritance in Organisms 


Applications of Science in Mathematics, 




Evolution, Speciation, Diversity 


Technology 




Chemical Properties of Matter 


History of Science & Technology 




Atoms, Ions, Molecules 


World Population 




Subatomic Particles 


Food Production, Storage 




Explanations of Physical Changes 
Chemical Changes 


Nature of Scientific Knowledge 
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Table 5.2 (continued) 

Science Topics Intended for Introdnction in Varions Stages. 



Grade Group 


Topics That Half the Countries Intended for Introduction in Grade Group 


9 to 12 


Evolution of the Universe 


Energy & Chemical Change 




Biochemical Processes in Cells 


Nuclear Chemistry 




Biochemistry of Genetics 


Electrochemistry 




Macromolecules, Crystals 


Relativity Theory 




Wave Phenomena 


Fluid Behavior 




Kinetic Theory 


Influence of Mathematics, Technology in 




Quantum Theory, Fundamental Particles 


Science 




Explanations of Chemical Changes 


Influence of Science, Technology on Society 




Rate of Chemical Change & Equilibrium 


Influence of Society on Science, Technology 




Organic & Biochemical Changes 


Science & Mathematics 
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and transformation of matter and energy. Additional topics were introduced in the areas of 
environmental science, resource conservation, pollution, ecology, and ecosystems. 

Grades 7 and 8 (key transition grades) saw introduction of mostly topics in physical science 
(especially chemistry) and technology. The topic of physical changes was expanded to include 
‘explanations of physical changes.’ Additional environmental and resource areas, such as 
‘world population’ and ‘food production and storage,’ were also introduced. For the first time, 
content on ‘nature or conceptions of technology’ and ‘applications of science in mathematics 
and technology’ was widely introduced across TIMSS countries. 

Not surprisingly, grade 9 and beyond was characterized typically by the introduction of 
more advanced topics. Advanced topics in the life sciences included ‘biochemical processes in 
cells’ and ‘biochemistry of genetics.’ Mostly topics in the physical sciences are introduced, 
including ‘relativity theory.’ The earth science topic of ‘evolution of the universe’ is introduced 
also, most likely as part of astronomy in the physics curriculum. 

Country Comparisons 

Tables 5.1 and 5.2 characterize typical or “common denominator” curricular intentions 
across the science framework topics and the TIMSS countries, by presenting median grade lev- 
els for topic introductions. In actuality, some countries introduced any given topic earlier, oth- 
ers later. This section discusses these deviations from the median by individual countries. 

Figure 5.1 presents, for all TIMSS countries, the number of topics introduced either 3 years 
earlier or later than the median. Note that this figure only addresses when topics were intro- 
duced, not duration or years of special focus. 

Four countries stand out in this figure: Canada, Mexico, Portugal, and Slovenia. They dif- 
fered by having more than 25 topics introduced three or more grades earlier than the median 
grade for that topic. This example of consistently introducing science topics earlier than the 
majority of TIMSS countries clearly reflects a very different distribution of opportunities to 
learn than that represented by the median. It is also likely to be reflected differently in educa- 
tional attainments measured by the TIMSS achievement tests — to the extent that these tests 
reflect something like the profile of medians for science topic introduction — although this dif- 
ference in scores would more clearly be seen for topics for which coverage in these four coun- 
tries was a great deal earlier than typical for the test population grades. Such coverage differ- 
ences would also be complicated by whether, after introduction, the curriculum in question 
focused more heavily on these topics than was typical. Such a consistent pattern is likely not 
due to accident. One might infer that these differences most likely reflect a particular curricu- 
lar vision and are based on a deliberate set of aims underlying the science curriculum in these 
countries. 
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Figure 5.1 

Number of Topics Introduced Very Early or Very Late. 

Some countries introduced many topics far earlier than was typical and some topics far later. 






Figure 5.2 

The Eight Topics Whose Introductory Grade Varied Most. 

Many topics varied considerably among countries in terms of the grade in which they were introduced. 
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The patterns for the other countries were more mixed. Still, as figure 5.1 makes clear, many 
countries show marked differences from the median — and often for several science topics. 
Clearly these differences reflect cross-national variations in curricular visions, and their imple- 
mentations in science curricula make the task of comparative attainment testing more difficult, 
and make caution critical to interpretation of achievement results. 

Topics showed considerable variation in the grade in which they were introduced. Such 
variation reflects strong diversity in the curricular visions that helped determine the time in 
which science topics were introduced in schooling in the curricula examined. Figure 5.2 pre- 
sents data for eight topics showing greatest diversity; that is, those topics that TIMSS countries 
introduced at least 3 years earlier or later than the median. Any TIMSS country not included in 
figure 5.2 differed from the median by less than 3 years for that topic. 

‘Rocks, soil’ is one of the more elementary of these eight topics, and 13 countries differed 
by more than 3 years from median grade 4. Most of the countries introduced this topic later. 
Denmark, for example, introduced it in the 11th grade, 7 years after the median grade. Other 
countries introduced this material earlier, including Canada, which introduced it in the first 
grade. 

Six countries introduced ‘earth in the solar system’ 3 or more years earlier than the median 
(which also was grade 4); only four countries — Hungary, Iceland, the Netherlands, and the 
People’s Republic of China — introduced it 3 or more years later, perhaps in a more sophisti- 
cated fashion. 

The life sciences topics of ‘other organisms’ and ‘sensing and responding’ had later medi- 
an introductory grades - grades 6 and 7, respectively. Variation in introduction of these topics 
was quite large: 1 1 countries introduced the first of these topics 3 or more years from the medi- 
an grade. In the case of the second topic, 16 countries varied 3 or more years from the median 
introductory grade, with the overwhelming majority introducing it earlier (Australia and 
Slovenia introduced this topic in grade 2). 

Four physical science topics exhibited considerable variation in introductory grades. ‘Wave 
phenomena’ was introduced in 14 countries 3 or more years earlier or later than the median 
introductory grade 9. The topic ‘sound and vibration,’ exhibited perhaps the most notable vari- 
ation: 22 countries introducing this topic 3 years earlier or later than the median introductory 
grade 6 — ranging from Hong Kong, New Zealand, Norway, and Portugal, which all introduced 
this material in grade 1, to Argentina, the two Belgian systems, and Tunisia, which introduced 
it in grade 12. 

‘Physical changes,’ the science framework category denoting the study of gas laws, changes 
in states of matter, etc., was introduced in only three countries 3 years earlier than the median 
grade 4, while 13 countries introduced it 3 or more years later. In the case of ‘time, space, and 
motion,’ 18 countries introduced this material 3 or more years earlier or later than the median 
grade 6. 
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Duration of Topic Coverage 

This sections looks at variations in how many grades various science topics were intended 
to be included in the curriculum. The duration data were derived by determining the number 
of grades during which curricular attention was given to each topic within each country. 
Duration must not be confused with instructional time. There is no reason to suppose that stu- 
dents in a country in which a particular topic is revisited and developed over a period of years 
are exposed to more instructional time in total than those where the topic is taught to mastery 
within a lesser number of years. The mean duration for each topic (across countries) and the 
mean duration for each country (across topics) was then calculated. 

Unfortunately, there is no simple interpretation of average duration in an absolute sense. 
Some topics (for example, ‘quantum theory’) were widely covered in only a few grades. Other 
topics (for example, ‘animal types’) were widely covered over comparatively more grades. Any 
averaging over topics should be weighted by some index of typical duration for each topic. 
However, as seen earlier, the variations from such averages were considerable. The approach 
taken here was to find unweighted averages — each topic counting the same — and to use the 
data only for cross-national comparisons. Thus, an average duration of three grades would 
mean little in itself; it would, however, be more meaningful to compare two countries, one of 
which had an average duration three grades more than the other. 

Overall Picture 

After the average country durations were derived, the median duration was found among the 
pool of reporting countries. From this, the difference from that median was calculated for each 
country. As shown in figure 5.3, differences range from more than 3 years shorter than the 
median to more than 3 years longer. One group — Germany, the Philippines, and Singapore — 
were at or near the median duration. Others — most markedly Tunisia, the People’s Republic 
of China, and Hungary — had an average duration less than the median; that is, on average, 
they devoted far fewer years than the median to covering a topic. At the other extreme, were 
countries like Canada, Slovenia, Switzerland, Portugal, and the Dominican Republic, which had 
comparatively high average durations. For some countries where the curriculum guides speci- 
fy content only for ranges of grades and not for specific grade levels, such a policy would result 
in longer durations for some topics. Also, countries without national curriculum guides, but 
with multiple subsystems and their corresponding guides, could — when aggregated to the 
country level — produce longer durations for some topics. As a result, the country-level dura- 
tions should not be interpreted as specific to individual students but rather to the country as a 
whole. 

The average duration across all countries was computed for each framework topic. In this 
case, since each participating country is considered equally important, an unweighted average 
was not misleading. These topic averages represent the average number of grades devoted to 
each topic across the pool of reporting countries. Figure 5.4 shows that the average topic dura- 
tions ranged from two grades (‘quantum theory,’ ‘relativity theory,’ and ‘fluid behavior’) to 
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Figure 5.3 

Average Number of Grades Intended Across Topics by Countries. 

Some countries had an average duration across topics that was far less than the median for all countries. 
Others had an average topic duration far greater than the median. 



Tunisia 

China, Peopie’s Repubiic of 
Hungary 
Latvia 
Romania 
Argentina 
Russian Federation 
Buigaria 
Cyprus 
Sweden 
Beigium (fi) 
Beigium (Fr) 
Japan 
Netheriands 
Czech Repubiic 
Iceiand 
Germany 
Phiiippines 
Singapore 
Mexico 
Greece 
Iran 
France 
Korea 
Siovak Repubiic 
New Zeaiand 
Ireiand 
Denmark 
Spain 
Israei 
Norway 
USA 
Austraiia 
Dominican Repubiic 
Portugai 
Switzeriand 
Siovenia 
Canada 



•4 




1 

■ 



I 

I 

I 




• 3 - 2-101234 

Number of Grades ' Number of Gtodes 

Average Durotion j Average Duration 

Less than the Median More than the Median 




INTENDED FLOW OF SCIENCE CURRICULUM 



77 



Figure 5.4 

Average Number of Grades Intended for Each Topic. 

More time was spent on some topics (longer average duration) than others, as these averages across all 
countries show. Other topics were covered for shorter times on average. 
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Figure 5.4 (continued) 

Average Number of Grades Intended for Each Topic. 
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eight grades. Those topics with higher average durations were typically themes integrated into 
science curricula for comparatively longer spans or periodically revisited — even if there were 
particular grades when they were the focus of special attention. 

Country Comparisons 

Within the context of these two sets of average durations, there was considerable variation in 
the time devoted to any given topic by individual countries. As figure 5.5 shows, there was con- 
siderably more variation by individual topic and country than there was in either set of averages. 

Some topics seem to have been commonly integrated into the science instruction of sever- 
al grades or revisited periodically. For example, ‘animals’ and instruction related to ‘magnet- 
ism’ were involved in an average of eight and six grades, respectively. Yet there are notewor- 
thy exceptions — the People’s Republic of China in the case of ‘animals’ and the Dominican 
Republic, Israel, New Zealand, and Slovenia in the case of ‘magnetism.’ 

Other topics, exhibited considerably less cross-national commonality. The study of ‘effects 
of natural disasters’ had an average duration of four grades. However, examining the duration 
of intended work on this topic in individual countries showed marked variation — from as few 
as one grade to as many as eight. For this topic and others, there appears to have been consid- 
erably less consensus about the duration of curricular attention devoted to them — and, by 
inference, about the approaches taken to them and the educational opportunities provided relat- 
ed to them. One approach for identifying these differences would be to see how intended cur- 
ricular attention for a given science framework topic differed among the countries. Here, a 
more complex approach was used that examined double differences. Statistical techniques 
were used to see how the duration for a given topic in a given country differed at the same time 
from that typical for the topic (across countries) and for the country (across topics). This yield- 
ed a single number indicating how differently that topic was treated by that country from how 
a typical country treated a typical topic. 

Figure 5.5 presents the data on these double differences for countries and topics that had 
many combined differences that were four or more grades greater or fewer than typical. The 
row of numbers indicate each country ’s typical topic duration and the column of numbers indi- 
cate each topics typical duration. Grey-shaded icons indicate fewer years than typically intend- 
ed; black icons indicate more years than typically intended. As shown, there was considerable 
diversity revealed by this analysis; display of the data for all countries (see appendix I, figure 
15.5) would make the overall diversity even more striking. 

The 14 topics in figure 5.5 showed strong differences in many countries, some with con- 
siderably fewer intended for each topic. Countries also differed in how often large “double 
differences” emerge. In New Zealand, such differences emerged for seven topics that dif- 
fered by 3 years or more. In Canada and Korea, only two differences of similar magnitude 
were present. 
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Figure 5.5 

Specific Country/Topic Durations Compared to What Was Typical. 

Statistical methods were used to produce numbers indicating how many fewer (gray-shaded icons) or more 
(black-shaded icons) grades the duration for a specific country and topic was from the duration for a typical 
country and topic — that is, a double difference. Considerable diversity is shown. 
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The flow of science curricula in the TIMSS countries differed not only in when individual 
topics were introduced into their science curricula, but also in terms of how long topics contin- 
ued to receive curricular attention (duration). These differences in placement and topic cover- 
age must have consequences for educational attainments and would seem to be important fac- 
tors to consider in accounting for such differences. 

Covering Multiple Topics 

One way to characterize countries’ differing curricular patterns is to examine how curricu- 
lar attention was divided among science topics at each grade. Figure 5.6 presents such data for 
various TIMSS countries. Certain cross-national differences are readily apparent. 

One broad distinction is between more focused and more diverse curricula. Examining the 
average number of topics across the grades, the picture that emerges is one of broad, simulta- 
neous — within a single grade — coverage of many topics or of attention restricted to a few 
topics. The data make clear that most countries presented an additive or “fanning” pattern of 
curricular intentions. In each of these countries, a comparatively small number of topics 
received attention in early grades, with new topics being introduced steadily each year. This 
pattern contrasts markedly with the pattern found for mathematics, which showed the predom- 
inance of a “curvilinear” pattern: one in which few topics are introduced in early grades and 
progressively added to until some midpoint, at which progressively fewer topics were intend- 
ed. This resulted in a “bell-shaped” or “normal-curve” pattern. 

There appear to be three principal variations on the predominating additive pattern in cur- 
ricula for the sciences. 

• “Purely” additive curricula — countries like Australia in which there was a steady 
increase in the number of topics intended in each successive grade. In grade 1, these 
curricula showed the smallest number of topics intended; the largest number of topics 
appeared in the final grade of upper secondary. 

• A higher rate of addition in early grades reaching a “saturation” point early in the sec- 
ondary grades, and from this point onward a fairly consistent high number of topics. 
Cyprus and Greece exemplify this pattern. 

• A slight reversal of the additive pattern in the final grades of upper secondary, such as 
in Norway and Sweden, where there was a slight reduction in the number of topics 
intended at the end of upper secondary. 

In addition to the prevailing additive pattern, there were a few noteworthy exceptions: 

• Some countries intended a comparatively small number of topics throughout the grades, 
indicating more focus on fewer topics. This pattern resulted in a “leaner” profile, and is 
best exemplified by Argentina. Another group of countries, which included the People’s 




Figure 5. 6 

Number of Topics to Be Covered for Each Grade in Each Country. 

The number of topics to be covered in various grades differs considerably across countries. 
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Note: Data forthe secondary level within countries pertain tothe general track only. 




Figure 5.6 (continued) 

Number of Topics to Be Covered for Each Grade in Each Country. 









Slovak Republic Slovenia 



INTENDED FLOW OF SCIENCE CURRICULA 



85 





86 



MANY VISIONS, MANY AIMS 



Republic of China and Hungary, also presented a lean or focused profde, but with an 
increase in the number of topics intended in upper secondary. 

• Another group presented a more consistently diverse pattern. These intended a high 
number of topics throughout the grades, as was the case for Canada and Portugal. 

• Finally, another noteworthy exception was that of countries that presented in science the 
same curvilinear pattern of curriculum discovered as the predominant pattern in mathe- 
matics. Thus, the Czech and Slovak Republics, Switzerland, and the United States 
exemplify countries that started out with an additive pattern until the middle grades and 
then presented a subtractive pattern such that the middle grades were characterized by 
intentions to cover more topics than in either lower primary or upper secondary. 

The data presented in figure 5.6 are descriptive — and suggestive. Inferences about the dis- 
tribution of instmctional attention among topics can be stated only at the most global level from 
these data — not all science framework topics are of equal importance generally nor were they 
within any given reporting country. Not all topics require the same amount of instmction. 
However, at a global level, a country that deals with many topics within a grade would seem 
likely to differ in the organization of its educational opportunities, in its textbooks and curricu- 
lar materials, and in its curricular intentions and visions from a country that clearly restricts 
attention — even at this global level — to only a few topics. Countries clearly showed a diver- 
sity of curricular visions in this way. 

Figure 5.6 portrays how topics accumulated over the years of schooling in each country. 
After they entered the science curriculum of a particular country, did they ever exist? The addi- 
tive pattern seen for many countries in figure 5.6 provides no obvious indication. The data for 
how many topics received attention do not directly portray whether topics were dropped at 
some point. They also do not indicate how many topics were introduced for the first time at a 
given grade. Figure 5.7 combines information on the number of topics introduced and the num- 
ber of topics dropped at each grade within a country’s curriculum. Each topic is considered to 
be introduced or dropped from the curriculum only once. These data show more directly how 
diversity was created and how it changed over grades. 

Some countries regularly added topics and dropped comparatively few — that is, their sci- 
ence curricula grew incrementally over the grades. Clearly included among these were 
Australia, France, and Spain. Others regularly added topics in the early grades and then most- 
ly dropped topics. Most notable among these were the Dominican Republic and both the Czech 
and Slovak Republics. 

Of particular interest are those countries that both introduced and dropped topics frequently 
— that is, countries with comparatively constant changes in curricular attention. While the over- 




Figure 5.7 

Number of Topics Introduced and Dropped. 
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all multiplicity of topics attended to might not increase as much as in other countries, the changes 
of topic indicated by frequent introduction and dropping of topics were clearly comparatively 
great. This group includes Hungary, Greece, and Germany. These countries reveal a pattern of 
changing focus — either broad or narrow depending on the actual number of topics in the cur- 
ricular stream — of devoting attention to a number of topics but not to the same topics over the 
years. Countries with a high degree of change in focus are particularly interesting. 

Thus, overall, three predominant patterns were identified for science curricula — continued 
progressively more diverse focus, increasing diversity in early grades changing to increasing 
focus in later grades, and changing comparatively diverse science curricula. 

Some other patterns worth noting: 

• Countries in which a significant number of topics are introduced only in certain “water- 
shed‘ ’ grades. That is, countries that only have a limited number of grades, distributed 
throughout the years of schooling, in which large numbers of topics are introduced. 
Such is the case of grades 3 and 7 in Ireland and grades 1, 4, and 7 in Norway. 

• Countries that seem to mostly introduce topics in the early grades, dropping them only 
in later grades, such as in the Dominican Republic and the Czech Republic. 

• The People’s Republic of China and Hungary stand out as the only countries where the 
introduction of new topics occurs at a higher rate at grade 7 and beyond. 
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Note 

‘ This ranking applies only at the most detailed level; the eight highest level categories (for 
examples, earth science, life sciences, physical sciences, etc.) are not listed in any order. 
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Chapter 6 

Milestones in Science Curricula 

So far, this analysis has focused on broad patterns in the flow of science curricula — patterns 
of intended topics across the span of grades. Such proposed coverage was not evenly distrib- 
uted and varied considerably from grade to grade. The data from the Third International 
Mathematics and Science Study (TIMSS) allowed examination of the focus of intended cover- 
age at each grade. Content covered in curriculum guides and textbooks for selected grades can 
also be examined in some detail. This chapter examines the distribution of focus topics across 
grades and, in some detail, in the upper grades of the TIMSS target populations. This includes 
examination of the match between intended coverage as expressed in curriculum guides and 
textbooks. Finally, there is an attempt to characterize the broadest level of content commonal- 
ity in those target grades by examining specific commonly intended topics. 

Patterns of Topic Focus 

Much of the data used thus far were gathered by surveying science curriculum experts in 
each country, framework topic by topic. These experts used national curriculum guides to pro- 
vide data on the grades in which various science topics were introduced and concluded and, 
thus, information on the coverage duration for the various topics. These experts were also 
asked to provide information on the grades within which comparatively greater focus was given 
to particular science topics. These data, although drawn from informed expert judgment rather 
than document analysis, provide an initial, direct look at whether and when particular science 
topics received special attention and focus in the curricular flow of each country (see table 5.1 
in chapter 5). 

Broad commonalities emerge for the grades in which particular science topics were indi- 
cated for intended special focus. Some topics of comparatively less significance had no focus 
indicated by a majority of countries, but most did. These commonalities in topic focus make 
up a “common denominator” focused curriculum, a curriculum made up of the sequence of 
those topics that were indicated as receiving particular focus in the various grades. 

Several topics of focus appeared in grades 7 and 8. Among these were most earth science 
topics from the science frameworks and also the most elementary life sciences topics from 
the topic areas of ‘diversity, organization, structure of living things,’ ‘life spirals,’ and some 
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elements of environmental science, ecology, and animal and plant behavior. The only phys- 
ical sciences focused on in these grades by most countries are ‘heat and temperature’ and 
‘physical changes.’ 

In grades 9 and 10, physical science became a major focus. Some topics in environmental 
and resource issues related to science were also focused on in these grades. 

A final set of focus topics were uncovered for grades 11 and 12. These included work on 
the majority of topics in ‘chemical transformations’ and a focus on the majority of ‘energy and 
physical processes’ topics. 

Similarities of curricular focus were in a context of persistent — and at times large — diver- 
sity. Based on the common denominator focus pattern of table 5.1 for selected, representative 
countries and science topics for which the diversities were more marked, figure 6.1 presents 
most of the countries and topics that showed differences of grade levels from the majority focus 
grade. 

Certain topics showed differences from the majority focus grade more often. ‘Rocks, soil’ 
was a focus for four or more grades earlier in at least two countries — Canada and Israel — 
indicating that there were countries that shared the characteristic of early focus on such mater- 
ial. Material on biological variation and inheritance was also focused on comparatively earlier 
in Denmark, Mexico, and the Slovak Republic. Denmark and Israel also focused on ‘evolution, 
speciation, and diversity’ topics very early. 

In addition to science topics that showed some large differences, some countries showed a 
number of differences from the common denominator profile of science topic focus grades. For 
example, for topics in the earth and life sciences as well as in the category of ‘energy and phys- 
ical processes,’ Israeli experts indicated a much earlier focus in contrast to the more common, 
majority focus grades. 

Topics in the physical sciences showed interesting variation in patterns of focus. Grade 1 1 
was the point at which most countries focused on the topic of ‘electricity.’ Some countries, 
however, focus on this topic in lower elementary school from 8 to 10 years prior to grade 11 
(i.e., Israel and Japan). Some countries waited until the final grade of upper secondary school 
to focus on this topic, as was the case for Flemish-speaking Belgium. 

The data from table 5.1 clearly indicated that there were some broad commonalities in the 
grades in which many science framework topics received special attention. However, figure 6. 1 
shows that there were also marked diversities (see appendix I, figure 16.1 for all countries). 
Certain topics — for example, ‘light’ — received special attention in several countries at char- 
acteristically early times. Certain countries — for example, Israel — show a pattern of frequent- 
ly having focused on at least some contents earlier than did the majority. The pattern of topic 
focus for individual countries and topics was one of considerable cross-national diversity. 
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Figure 6.1 

Focus Differences from the Majority for Selected Countries. 

For most topics there was one grade by which a majority of countries had focused on the topic. Individual coun- 
tries had foci that differed from the majority for at least some topics. A few countries were selected to illustrate 
the differences in which focus differed from the majority. Negative numbers (gray-shaded icons) indicate focus 
earlier than was typical. Some differences were large enough to indicate quite different approaches to the topics 
involved. 
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Commonly Intended Topics Across Grades 

The portraits drawn in chapter 5 and earlier in this chapter sought to capture the flow of a 
common denominator curriculum and to illuminate the background diversity in the details of 
particular topics and countries that lay behind commonly intended coverage. The broadest find- 
ings were clear — strong common features amid considerable diversity. The data were often 
portrayed to clarify differences among individual countries and topics. While this presentation 
was necessary, it has made it hard thus far to assess the degree of agreement among the coun- 
tries — how common the different common denominator factors were in content coverage and 
content focus. Data are presented in this section in an effort to remedy this problem. 

What proportion of the TIMSS countries covered a given science framework topic in a 
given grade? To answer this question in detail would require a two-dimensional grid of topics 
by grades and a percentage in each cell of the grid — each combination of topic and grade — 
indicating what proportion of the countries cover that topic in that grade. Such data require sim- 
plification if any sense of the underlying patterns is to emerge. An important simplification here 
— a reduction in the complexity portrayed — is not to portray every percentage numerically. 
Thus, we empirically identified a limited set of percentage levels that captured important dif- 
ferences among topics and countries. 

Through the identifying process, we found that 70 percent and 10 percent were important 
milestones in commonality, partitioning countries and topics in a way that revealed important 
differences in content coverage. Four categories were used: 

• More than 70 percent of the countries covered the given topic at the given grade level; 

• From 10 to 70 percent of the countries covered it; 

• Some countries, but fewer than 10 percent covered it; and 

• No countries covered the given topic at the given grade level. 

While the choice of 10 percent and 70 percent was arbitrary, it was based on careful analysis to 
determine which cutoff percentages would best create a small, illuminating set of coverage levels. 

Figure 6.2 presents these data on content coverage for the full range of science framework 
topics and for the full range of grades. Once we identified the four categories described above, 
a set of icons were created to portray these categories — essentially high, moderate, low, and 
no agreement across the pool of countries. This is an indication of common curricular inten- 
tion, not of focus. Here, inclusion was determined simply by whether a country indicated that 
a topic received some attention during the grade in question. These patterns present the broad 
outlines of which topics were commonly intended cross-nationally. 

The number of filled icons — indicating at least 70 percent coverage — is relatively small. 
Only a few regions of filled icons emerge to indicate more inclusive content categories and spans 
of grades with broad commonality. For example, such regions include work with ‘plants, fungi’ 
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and ‘animals’ from grade 3 to grade 8; ‘pollution’ and ‘resource conservation’ in grades 7 to 11; 
‘life cycles of organisms’ and ‘reproduction of organisms’ in grades 5 to 11 ; and various aspects 
of physical and chemical properties of matter from grades 7 and 8 up to grades 10 and 11. 

The patterns that emerge are quite striking. In the earth sciences, the lowest grade at which 
70 percent or more countries covered a given topic was for ‘bodies of water,’ ‘weather and cli- 
mate,’ ‘physical cycles,’ and ‘earth in the solar system’ at grades 4 and 5. Most of the topics in 
this area are covered by the majority of countries in upper elementary and lower secondary 
school. 

Life science is also generally emphasized in upper elementary and lower secondary school. 
Plant and animal taxonomy dominate elementary and lower secondary curricula (grades 3 
through 8), with topics such as ‘organs, tissues’ being largely covered at the same time. 
Ecological topics such as ‘biomes, ecosystems,’ ‘habitats, niches,’ and ‘interdependence of life’ 
are covered by most countries in lower secondary school. However, at least 70 percent of the 
countries covered the latter topic throughout most of lower and upper secondary school. 

Physical sciences were covered later: 70 percent or more of the TIMSS countries covered 
most of this framework area in grades 7 and 8, starting with ‘heat and temperature’ in grade 6. 
By grade 8, 70 of TIMSS countries were covering nine physical science topics from the gener- 
al categories of ‘matter,’ ‘structure of matter,’ energy and physical processes, and ‘physical 
transformations.’ 

Environmental and resource issues related to science were commonly covered in grades 7 
through 11. 

A similar — but more finely detailed — portrait can be drawn by providing an analogous 
display for indicated focus on, rather than coverage of a particular topic in a particular grade. 
Figure 6.3 presents focus data for the full range of science framework topics and for the full 
range of grades. In this analysis, inclusion in computing a percentage was determined by 
whether a country indicated that a topic received a focus during the grade in question. The cut- 
offs (10 and 70 percent), four common intention levels, and icons are the same as those used in 
figure 6.2. 

There are no filled icons in the entire figure. Many of the filled icons from figure 6.2 are 
now shaded to indicate moderate agreement at the 10 to 70 percent level — as are many of the 
icons that were already at this moderate agreement level in the consideration of coverage only. 
Achieving a high degree of common intention at the focus level would indicate more serious 
common commitments of instructional attention. Topics that did achieve a high level of com- 
monly attended focus would be, more precisely, the cross-national commonalities for which 
comparable attainment measures would be most appropriate at the grades indicated. It is per- 
haps in this sense that figure 6.3 is most cautionary — and disheartening. No matter what set 
of grades was selected, there would be no topics within it for which more than 70 percent of the 
countries indicated an intention to focus instructional attention. 
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Figure 6.2 

Proportions of Countries Covering Each Topic at Each Grade. 

The actual percentages of countries covering each topic at each grade were used to identify a coverage level 
indicated by one of four symbols. The display makes it easier to identify topics and grades for which there 
were strong similarities in content coverage. 
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Figure 6.2 (continued) 

Proportions of Countries Covering Each Topic at Each Grade. 



cience Topics 


P 


1 


Organic & Biochemical Changes 


O 


o 


Nuclear Chemistry 


O 


o 


Electrochemistry 


o 


o 


Forces & Motion 






Types of Forces 


o 


o 


Time, Space, & Motion 


o 


o 


Dynamics of Motion 


o 


o 


Relativity Theory 


o 


o 


Fluid Behavior 


o 


o 


Science, Technoiogy, & Mathematics 


o 




Nature or Conceptions of Technoiogy 


o 


interactions of Science, Mathematits, 






& Technoiogy 


o 


o 


Influence of Mathematics, Technology in Science 


o 


o 


Applications of Science in Mathematics, Technology 


o 


o 


Interactions of Science, Technology 




o 


& Society 


o 


Influence of Science, Technology on Society 


o 


o 


Influence of Society on Science, Technology 


o 


o 


History of Science & Technoiogy 


o 


o 


Environmentai & Resource issues 






Pollution 


o 


3 


Conservation of land. Water, &Sea Resources 


o 


3 


Conservation of Material & Energy Resources 


o 


3 


World Population 


o 


o 


Food Production, Storage 


o 


o 


Effects of Natural Disasters 


o 


3 


Nature of Science 






Nature of Scientific Knowledge 


o 


3 


The Scientific Enterprise 


o 


o 


Science & Other Discipiines 






Science & Mathematics 


o 


o 


Science & Other Discipiines 


o 


3 



2 ^ 


3 ' 


4 ■ 


5 


6 


7 


8 1 


9 


10 1 


II 


12 1 


O 


O 


0 


0 


0 




3 


3 


J 


• 


3 


O 


O 


O 


o 


o 




3 


3 


3 


3 : 


3 


o 


O 


O 


o 


o 


3 i 


3 


3 


3 


• 

1 


3 


o 


3 


3 


3 


3 


3 


3 


• 


• > 


1 

• ] 


3 


3 


3 


3 


J 


3 


3 


• 


• 


• 


• ' 


3 


o 


O 


3 


3 


3 


3 


3 


3 


• 


3 


3 


o 


O 


O 


O 


O 


O 


O 


3 


3 


3 


3 


o 


o 


O 


o 


o 


3 


3 


3 


3 


3 


3 


o 


3 


3 


3 


3 


3 




3 


3 


3 


3 


o 


o 


O 


O 


O 


O 


O 


O 


O 


O 


O 


o 


o 


3 


3 


3 


3 


3 


3 


3 


3 


3 


o 


3 


3 


3 




3 


3 


3 


3 


3 


3 


o 


o 


O 


O 


O 


O 


o 


O 


O 


O 


o 


o 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


o 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


o 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


• 


• 


• 


• 


• 


3 


3 


3 


3 


3 


, 3 


• 


• 


• 


• 


• 


3 


3 


3 


3 


3 


3 


• 


• 


• 


• 


• 


3 


1 o 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


I® 


1 

j 


3 


3 


3 


3 


3 

1 


3 


3 


J 


3 


3 


3 


3 


3 


3 


3 


1 

1 

3 




O 


O 


O 


0 


1 ^ 


3 


3 


3 


3 


i 3 


3 


o 


3 


3 


* 


i ^ 


3 


> 




3 


3 


3 


3 


3 


3 


i ^ 


1 * 


3 




3 




i ^ 







legend; 


0 01 ledst 7Q% of the 


') 10k70Xoillie 


(3 olmosl10\ofthe 


0 no (ouftiiy (overed Ms 




(Mfliries (ovarod this topk 


(oentiies (ovef ed Ms topk 


(04Mtries (oveied the tepK 


topk ol Ms grode level 






olthis grade level 


at Ms grode level 


ol this grode level 


i 



MILESTONES IN SCIENCE CURRICULA 



101 



Figure 6.3 

Proportions of Countries Focusing on Each Topic at Each Grade. 

The same system as in the previous figure is used to portray topics and grades at which curricular attention was 
commonly focused. Far fewer common foci are seen than topics and grades with high common coverage. 
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Figure 6.3 (continued) 

Proportions of Countries Focusing on Each Topic at Each Grade. 
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Unless the items used to measure attainments are largely insensitive to curricular differ- 
ences, careful use of the curricular context of items must be an important part of interpret- 
ing achievement results. To achieve little in the face of limited relevant opportunity to learn 
is uninformative. 

Commonly Intended Topies at Focal Grades 

One of the strengths of the TIMS S’ curriculum analysis is that such expert opinion can be 
supplemented by more direct analyses of key curricular documents. If one re-examined the per- 
centage of countries that indicated particular science topics were to be covered — but using 
direct analysis of curriculum guides rather than expert judgments — would the portrait of com- 
monly intended topics change in significant ways? The data to answer this question are avail- 
able, but a tradeoff is essential. Curriculum guides and textbooks sampled in the TIMSS cur- 
riculum analysis focused on key grades relevant to the TIMSS achievement testing rather than 
on the full range of schooling. The expert data reviewed earlier was less directly based on cur- 
ricular documents but included all of the grades in the flow of science curricula across the years 
of schooling. If attention is limited here to particular grades — in this case, the upper of the two 
grades for which achievement testing is to take place for TIMSS Populations 1 and 2 — a more 
detailed portrait emerges of common intentions at these critical points in schooling. 

Table 6.1 presents data from science curriculum guides on the most commonly intended sci- 
ence framework topics. These data are only for the upper grades of TIMSS Populations 1 and 
2 — that is, the higher of the two grades containing the majority of 9-year-old and 13-year-old 
students, respectively, in each country. The table lists the science framework topics found in 
the curriculum guides for the indicated grade levels of at least 70 percent of the TIMSS coun- 
tries — a level comparable to high common coverage shown in figures 6.2 and 6.3. Further 
information is provided by the arrangement of these lists. Topics found widely only in cur- 
riculum guides, without mention and support in science textbooks for the grade level in ques- 
tion, are in the pair of lists at the top. Topics found in curriculum guides and supported by wide 
inclusion in the appropriate textbooks are in the middle pair of lists. Some topics were includ- 
ed widely in textbooks but were not in the corresponding curriculum guides. These are in the 
bottom pair of lists. Finally, topics that were found in the appropriate textbooks of at least 70 
percent of the countries in more than 6 percent’ of the blocks of those countries were consid- 
ered as being emphasized in the textbooks. These topics are indicated with an asterisk in table 
6 . 1 . 



As suggested by the curricular flow data in chapter 5, the commonly intended science cur- 
riculum at the upper grade of TIMSS Population 1 was essentially a curriculum of taxonomy in 
earth and life sciences, with some elements of physical science. ‘Plants, fungi’ and ‘animals’ 
were included widely in the curriculum guides and emphasized in textbooks. ‘Weather and cli- 
mate,’ ‘organs and tissues,’ ‘earth in the solar system,’ ‘interdependence of life,’ and some top- 
ics in the physical sciences also were included in the appropriate curriculum guides of more 
than 70 percent of the countries and supported — but not emphasized — by textbooks. 




Table 6.1 

Commonly Intended Science Topics. 
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There was a group of topics in the curriculum guides for the upper grade of Population 1 in 
more than 70 percent of the TIMSS countries that was not supported by corresponding materi- 
als in the textbooks. This group included materials on ‘bodies of water’ in the earth sciences 
and ‘human biology and health’ in the life sciences. It is noteworthy that a variety of topics in 
‘environmental and resource issues related to science’ — regarded by many TIMSS experts as 
an important element of science education reform in their countries (see chapter 2) — were 
found in more than 70 percent of the curriculum guides but were not supported in the textbooks. 
Curricular intention appears to be most clearly expressed by curriculum guides — with a sec- 
ondary, reflective role played by textbooks in many countries. Textbooks also play differing 
roles in classroom instruction in different countries, ranging from being a virtually invisible 
support used primarily by the teacher in some countries, to being a de facto determinant of the 
curriculum (at times in spite of official statements) in others. 

Care must be taken in drawing conclusions from the existence of commonly intended top- 
ics in curriculum guides that are not also supported in textbooks. However, the criterion of 
inclusion in curriculum guides for 70 percent of the countries makes it unlikely that these top- 
ics occurred in the guides only of those countries that made no significant use of textbooks. 
There clearly was some disagreement in the intentions of those that envisioned these science 
curricula and set their aims, and those who supported the implementation of the curricula by 
writing science textbooks. At the very least, these data suggest that student attainments in these 
areas must be carefully examined to help determine the relative impact of intentions articulat- 
ed by curriculum guides and intentions embodied — if not articulated in specific objectives — 
in textbooks supporting instmction. Additionally, it must be noted that in many countries there 
is an inevitable lag between publication of new curriculum guides and the development and 
marketing of new textbooks to support them. 

The commonly intended science contents at the upper grade of Population 2 were more 
diverse than the corresponding set for Population 1, perhaps reflecting the predominant “addi- 
tive” pattern of curriculum in the sciences. For this grade, the commonly intended topics 
included all those commonly intended for the upper grade of Population 1 except two: ‘bodies 
of water’ and ‘earth in the solar system.’ Physical sciences topics emerge as more heavily 
emphasized in this curriculum portrait — including new topics (relative to the upper grade of 
Population 1) in the areas of the ‘structure of matter,’ ‘energy and physical processes,’ and 
chemistry. The only topic specified widely in curriculum guides and emphasized — rather than 
merely supported — by textbooks was that of ‘organs, tissues. 

With the upper grade of Population 2, another category of topics emerged. Several topics 
appeared exclusively in textbooks and were not widely supported in curriculum guides. This 
suggests that the curricular intentions implicit in the inclusion of materials in textbooks were 
not always in full agreement with the explicit intentions of curriculum guides — and that the 
implicit aims of textbooks were somewhat more inclusive than the aims of guides. Given dif- 
ferent practices in textbook use — and widespread practices of teacher selectivity of textbook 
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content covered — and pending direct data from teachers on content emphases — no firm con- 
clusions can be drawn about this material in textbooks not supported in curriculum guides. The 
direct teacher data needed for further understanding is being collected as part of TIMSS. 

In the upper grade of Population 2 there are also more topics called for in guides that are 
not supported in textbooks. These include ‘human biology and health,’ which also was called 
for in Population 1 curriculum guides and not supported in textbooks. 

In addition, it is worth noting that aside from the traditional disciplines of life, earth, and 
physical sciences, another area is included in curriculum guides and supported (although not 
emphasized) in textbooks. These are topics dealing with science applications and technology. 

One feature of the data in table 6.1 is that for the upper grades of both Populations 1 and 2 
only a few science framework topics were widely included in curriculum guides and were both 
supported and emphasized in textbooks. Having moved from expert data to document-based 
data, it is possible to estimate fairly precisely what emphasis means in these cases. Two 
Population 1 topics were emphasized — ‘plants, fungi’ and ‘animals.’ One Population 2 topic 
was emphasized: ‘organs, tissues.’ These topics appeared in more than 70 percent of the coun- 
tries’ curriculum guides and more than 70 percent of the countries’ textbooks. Further, at least 
6 percent of the textbook blocks in each of these 70 percent of the countries were coded to indi- 
cate treatment of that content. 

This indicates how widespread was the inclusion of these topics. But how extensive was 
the textbook emphasis? One emphasis measure is the average percentage of total textbook 
blocks devoted to each of these topics across the countries that included these contents in the 
appropriate grade-level textbook. This measure yields the relative amount of space on average 
devoted to each of the topics. Since the measure is a proportion of blocks, it compensates for 
differences among coders in block sizes, linguistic densities, textbook sizes, etc; that is, it pro- 
vides a self-adjusting measure of relative emphasis. 

On average, only a bit more than a quarter of the Population 1 upper grade textbooks’ blocks 
were devoted to the combination of the emphasized topics. Thus, although a significant por- 
tion of the Population 1 curriculum appears to have been plant and animal taxonomy, this topic 
accounts for only about a quarter of the curriculum. Of course, the actual proportion of this 
material used, as well as the extent to which this material was supplemented, can only be pre- 
cisely determined by direct teacher data. Even so, these data are strongly suggestive of the 
importance of these central, commonly intended topics and help to further characterize the 
Population 1 curriculum. The data for the upper grade of Population 2 are much less signifi- 
cant — the single emphasized topic (‘organs, tissues’) accounted for only about 6 percent of a 
textbook’s blocks on average. 

These data present a noteworthy contrast with similar data from mathematics curricular 
documents. In science, the two commonly intended topics receiving most emphasis in text- 
books intended for the upper grade of Population 1 take up about one-quarter of textbook space. 
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In mathematics, approximately 60 percent of space in textbooks are devoted to the most empha- 
sized commonly intended topics. A similar phenomenon occurs for the upper grade of 
Population 2 — whereas only 6 percent of science textbook space is devoted to commonly 
intended emphasized topics, these type of topics take up about 20 percent of mathematics text- 
books. 

For the targeted grades in TIMSS populations, a wealth of information now characterizes 
more precisely the science content of the curriculum. Data are available on which topics were 
widely mentioned in curriculum guides and which were widely supported by inclusion in sci- 
ence textbooks. By including expert data on the flow of curriculum, the portrait can be extend- 
ed to include whether a topic had been treated in the curriculum prior to a targeted grade or was 
intended for later treatment. 

The task of coordinating these data and forming a more complete overall portrait of the par- 
ticular topic as milestone content (or not) in a particular country is daunting. One attempt to 
combine these varying data for the upper grade of Population 2 is given in appendix I, figure 
16.4. Data for a representative selection of countries and topics are shown in figure 6.4. 

In this figure, each column represents a country and each row a topic. Each cell is thus a 
combination of topic and country — a visual summary of the treatment of that topic in the upper 
grade of Population 2. Each cell contains potentially four symbols: an arrow pointing to the 
left, an arrow pointing to the right, and, between them, either a dash or cross. Any of these sym- 
bols can be absent in any case. The arrow to the left indicates that curricular flow data sug- 
gested that this topic was intended to be covered by this country in at least one grade prior to 
the upper grade of Population 2. An arrow to the right similarly indicates that the data sug- 
gested that it was intended that this topic be covered in at least one grade after the upper grade 
of Population 2. The presence of both arrows indicates that the target grade was centered in 3 
or more years of intended coverage. 

In the center position, a dash indicates that the topic for that country appeared in its cur- 
riculum guide as intended for coverage at the upper grade of Population 2, but did not appear 
in the corresponding textbooks. A cross indicates that the topic both appeared in the curricu- 
lum guide and was supported by a relevant textbook for the upper grade of Population 2 in that 
country. The data presented in the center position comes from the document analyses; the 
arrows from the flow data are supplied by expert opinion. 

Almost every possible combination of the four symbols is found in some cell. For some 
countries, coverage at this Population 2 target grade came at the end of previous coverage; for 
others it came at the beginning of continued coverage. In only two cases was the coverage 
restricted to this single upper grade of Population 2: for ‘physical properties of matter’ and 
‘chemical properties of matter’ in Hungary. The figure’s pattern is one of considerable diversi- 
ty in terms of textbook support, prior coverage, and intended future coverage. Countries var- 
ied from topic to topic; topics varied among countries. The data again suggest how difficult it 
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Figure 6.4 

Coverage of Commonly Intended Topics Over Time. 

The cross-section of commonly intended topics at the upper grade of Population 2 is here supplemented by 
the curricular flow data to show whether a topic was widely covered in guides and/or textbooks, was 
intended to be covered before, or was intended to be covered later. This figure presents data for a sample of 
countries and topics. 
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was to specify a reasonable set of common achievement items to measure science attainments 
in this context of diversity in which virtually every comparison must be carefully interpreted. 
Some topics were clearly inappropriate for some countries — if all coverage was intended for 
the future — although that was rare. Probably the highest level of appropriateness was in the 
case of a cross surrounded by both a right and left arrow — for this situation the topic involved 
was in mid-sequence instructionally, was targeted in the curriculum guide as a curricular aim, 
and had its implementation supported by materials from an appropriate textbook. Other pat- 
terns indicate lower levels of appropriateness. 

Attention now turns to Population 3. While achievement testing of this population is for a 
sample of all students at the end of secondary school on quantitative and scientific literacy, a 
subpopulation has been defined as those students currently taking advanced physics. 
Consideration here is restricted to this sub-sample of physics “specialists,” since they were the 
only students at the end of secondary school for which curricular documents were sampled. 

With this restriction in mind, a portrait can be made of the topics commonly intended for 
these physics specialists at the end of secondary school. The list of those topics included in at 
least 70 percent of the appropriate science curriculum guides is found in table 6.2. As before, 
these lists are arranged by whether the topics were in curriculum guides only, in curriculum 
guides and supported by textbooks, or only supported in textbooks. Emphasis in textbook sup- 
port is again indicated by an asterisk (covered in at least 6 percent of textbook blocks). 

The specialist curriculum — unsurprisingly in view of its definition — was primarily one 
of physical sciences with some topics in science applications and technology (called for in 
guides, not supported by textbooks). What is perhaps more surprising is the preponderance of 
topics that would appear to indicate a curriculum mostly devoted to 19th century physics. 

Six topics, five in the area of energy and physical processes and one in the area of forces and 
motion, were not only supported, but also emphasized in textbooks. A large portion (approxi- 
mately 70 percent) of textbooks are commonly devoted to these emphasized commonly intend- 
ed topics — almost 20 percent of the books are devoted to the topic of ‘electricity’ alone. The 
remaining five topics are commonly present in approximately 10 percent of the blocks each 
(somewhat less for ‘energy types, sources, conversions’). The topic of ‘energy types, sources, 
conversions’ is also commonly intended in the upper grades of Populations 1 and 2. 

The list of topics in 70 percent of textbooks, but not called for in 70 percent of curriculum 
guides, is noteworthy: ‘kinetic-molecular theory’ and ‘relativity theory.’ 
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Table 6.2 

Commonly Intended Topics for Physics Specialists. 

Here are the common topics for physics specialists at the end of secondary school. These topics were in the cur- 
riculum guides and/or textbooks of at least 70 percent of the countries; those indicated with an asterisk were also 
emphasized in textbooks. 



Population 3 Specialists 

Curriculum Guides (Not in Textbooks): 

Atoms, Ions, Molecules 
Macromolecules, Crystals 
Heat and Temperature 
Nuclear Chemistry 

Science Applications in Mathematics, Technology 



Curriculum Guides (Included in Textbooks): 

Subatomic Particles 

* Energy Types, Sources, Conversions 

* Wave Phenomena 
Sound and Vibration 

* Light 

* Electricity 

* Magnetism 

Quantum Theory, Fundamental Particles 
Types ofForces 

* Time, Space, and Motion 
Dynamics of Motion 



Exclusively in Textbooks: 

Kinetic-Molecular Theory 
Relativity Theory 



Note: Topic emphasized in textbooks. 
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' Six percent was determined empirically as a cutoff level that separated textbooks that devot- 
ed considerable space to a topic — here considered as emphasizing it — from those that 
gave only some (comparatively little) space to covering the topic. 

2 This category of the science framework includes both the structure and function of tissues, 
organs, and organ systems (for example, digestion, excretion, circulation). 
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Chapter 7 

Emphasized Curriculum Topics 

Analysis of the curricular visions and aims of the TIMSS countries revealed a number of com- 
monly intended topics at several grade levels. Underlying these similarities are myriad differ- 
ences in coverage patterns and emphases. How many topics did a country address in a year? 
Did these topics receive equal emphasis? Was coverage of a particular topic concentrated over 
one school year or diffused over several years? How much emphasis did textbooks give to 
these topics? No single indicator or analytic method can address these questions. 
Consequently, we used several measures, including the following ones listed below: 

• Topics covered in both curriculum guides and textbooks; 

• Number of topics covered during a school year; 

• Share of curricular attention devoted to each topic; and 

• Percentage of textbook blocks devoted to specific topics. 

Each of these indicators yields estimates of at least one facet of emphasis or intensity in cur- 
ricular attention. Each measure has its own strengths and weaknesses. 

Emphasis as Agreement of Currieulum Guides and Textbooks 

How can one determine what topics countries emphasized in their science curricula? One 
measure is to see what was covered by their curricular materials. Those topics that both cur- 
riculum guides and textbooks agreed should be covered at a particular grade are special objects 
of curricular attention; they probably received more emphasis than topics without such agree- 
ment. 

Data on these agreements could only be considered on a by-grade basis; in the analysis they 
were limited to those grades for which data from both curriculum guides and textbooks were 
available. Table 7.1 presents these data for the upper grade of Population 2 for all countries pro- 
viding the needed data and for each of the science framework topics. 

A circle indicates that the topic was present in the relevant curriculum guide or guides for 
the country. A cross indicates that the topic was present in the relevant textbook or textbooks 
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Table 7.1 

Topics Present in Both Curriculum Guides and Textbooks. 

Topics present in both the curriculum guides and textbooks for a given grade level in a country probably received 



more emphasis than those not present in both. The data for all topics and all countries are shown here for the upper 
grade of Population 2. Few topics received unanimous emphasis in all countries, but many were widely emphasized. 
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a Refer to footnotes to figure 16.4 

b The country has requested that this topic be noted as absent in curriculum guides despite the inconsistency with the original coded data, 
c The country has requested that this topic be noted os absent in textbooks despite the inconsistency with the original coded data, 
d The country has requested that this topic be noted as present in curriculum guides despite the inconsistency with the original coded doto. 

e New Zealand doto include old and new curricula, Caution must be exercised in interpretation since the new curriculum spans all three focal populations, whereas the old curriculum slates by-grade objectives 
that hove been separated for each population. 

f In Scotland, textbooks ore used infrequently in science education. Caution b suggested when tomporing contents of guides to the of textbooks. 

g The Swedish curriculum guide for science states objectives for all grades from 1 through 9 inclusive, without detailing by-grade objectives. Thus, in this table, curriculum guide doto ore objectives for grades 1 
through 9, while textbook data are only for grade 7 (the upper population of Population 2). 

Missing Data: Argentina (no units of appropriate type), Belgium, Bulgaria, People's Republic of China, Iran (no official guides exist), Latvia, Lithuania, Thailand, and Tunisia. 
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Table 7.1 (continued) 

Topics Present in Both Curriculum Guides and Textbooks. 
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a Refer to footnotes to figure 16.4 

b The country has requested that this topic be noted os absent in curriculum guides despite the inconsistency with the originai coded data, 

c The country has requested that this topic be noted as absent in textbooks despite the inconsistency with the original coded data. 

d The country has requested that this topic be noted as present in curricuium guides despite the inconsistency with the originai coded data. 

e New Zeaiand data include old and new curricula Caution must be exercised in interpretation since the new curriculum spans all three focal populations, whereas the old curriculum states by-grade objectives 

that hove been separated for each population. 

f In Scotland, textbooks are used infrequently in science education. Caution is suggested when comparing contents of guides to the of textbooks. 

g The Swedish curriculum guide for science states objectives for all grades from 1 through 9 inclusive, without detailing by-grade objectives. Thus, in this table, curriculum guide data are objectives for grades 1 
through 9, while textbook daa are only for grade 7 (the upper population of Population 2). 

Missing Data: Argentina (no units of appropriate type), Belgium, Bulgaria, People's Republic of China, Iran (no official guides exist), Latvia, Lithuania, Thailand, and Tunisia. 
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Table 7.1 (continued) 

Topics Present in Both Cnrricnlnm Gnides and Textbooks. 
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b The country has reguesled that this topic be noted as absent in cuiricuium guides despite the inconsistency with the original coded data, 

c The country has requested that this topic be noted as absent in textbooks despite the inconsistency with the originai coded data. 

(f The country has reguesled that this lopio be noted as present in ourricuium guides despite the inconsislenoy with the originai coded data. 

e New Zeaiand data inoiude old and new curricula. Caution must be exercised in interpretation since the new curricuium spans aii three focai popuialions, whereas the oid curricuium states by-grade objectives 

that have been separated for each popuialion. 

f in Scoliand, textbooks are used infreguently in scienoe education. Caution is suggested when mmpahng contents of guides to the of textbooks. 

g The Swedish curricuium guide for science stales objectives for aii grades from 1 through 9 inciusive, without detailing by-grade objectives. Thus, in this table, curriculum guide doto are objectives for grades 1 

through 9, while textbook data are only for grade 7 (the upper papulation of Population 2). 

Missing Data: Argentina (no units of appropriate type], Belgium, Bulgaria, People's Republic of China, Iran (no official guides exist), Latvia, Lithuania, Thailand, and Tunisia. 
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for the country. Both symbols can appear independently. If both are present, there is agreement 
between curriculum guides and textbooks; this agreement probably represents positive evidence 
that particular curricular attention was intended for that topic in that grade. Circles alone at 
least suggest that attention was intended to be paid to the topic. 

As the table shows, many topics were covered with moderate to high levels of intensity — 
in the sense of guide and text agreement — in many countries. For instance, ‘organs and tis- 
sues’ was widely covered, as were both plant and animal types, ‘sensing and responding,’ 
‘reproduction,’ and ‘interdependence of life.’ In the physical sciences, several topics in ‘mat- 
ter’ were covered at moderate to high levels of intensity, as were some topics in ‘energy and 
physical processes.’ This was also true of ‘applications of science in mathematics, technology,’ 
‘pollution,’ and topics in ‘conservation of land, water, and sea resources’ and ‘conservation of 
material and energy resources.’ Canada, Colombia, and the United States showed agreement 
between guides and textbooks for most topics that they covered at all. Scotland and Russia also 
showed considerable agreement, although many other topics were present only in curriculum 
guides. Still other countries (for example, Hong Kong) showed at best modest agreement and 
only for a limited number of topics. 

Focused Versus Diverse Topic Coverage 

Instructional time — that is, time in which specific educational opportunities are made avail- 
able — is, of necessity, limited within any school year. This time has to be distributed among 
competing topic demands by the specific curricular visions and aims guiding science education. 
It is likely that a curriculum with many topics devotes less time on average to each — and 
markedly less to some topics if others receive more of the limited supply of instmctional time. 
Additionally, multiple topics imply shifts in attention among topics; this imposes a further limit 
on intensity of instruction. On the other hand, a curriculum of few topics per grade level — a 
focused curriculum — would entail fewer competing demands for curricular attention. In such 
a curriculum, it is likely that all topics would receive more, even if not equal, emphasis. 

Recall that figure 5.6 in chapter 5 shows that some countries consistently had more highly 
focused science curricula than others in the sense that a fewer number of topics were intended 
for a grade. Even countries with comparatively diverse curricula typically had at least some 
grade levels in which fewer topics were considered, thereby allowing comparatively more topic 
emphasis in those years. 

Variation in Emphasis in Tracing of Topic Coverage 

As noted above, curricular emphasis can be determined based on the number of topics com- 
peting for a fixed amount of instructional time within a country. We can make a more sophis- 
ticated analysis of curricular emphasis using topic coverage data provided by country experts. 
TIMSS gathered data from experts in each country on coverage of each framework topic. These 
experts indicated for each framework topic and each grade level whether the topic was covered. 
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not covered, or was a focus of curricular attention.* These responses were then weighted; top- 
ics not covered in a grade were assigned a zero weight for curricular attention, those covered 
and were not a focus received a weight of one, and those that were a focus received a weight of 
two. All the weights for each grade level’s topics within a country were then added together. 
This total provided an indicator of aggregate demand for curricular attention among the “com- 
peting” framework topics within that grade for that country. 

Total demand was then used to determine the share or proportion of curricular attention 
devoted to each topic within that grade and country. This was calculated by dividing zero, one, 
or two (as appropriate for the particular topic) by the weighted total for that grade and country.^ 

Obviously, a huge amount of data can be generated from this analysis. In the interest of 
space, attention here is restricted to the upper grade of Population 1. Figure 7.1 presents share 
or proportion and attention estimates for the upper grade of Population 1 . The figure contains 
data only for a sample of topics particularly relevant to this population. Similarly, in Population 
2 there was considerable variation — both among topics and among countries — in the default, 
“equal share” proportion of aggregate, within-grade curricular attention. This estimate of inten- 
sity revealed patterns similar to those of the other approaches. 

Variation in Emphasis in Textbook Topics for Populations 1 and 2 

Textbook data provide another approach to curricular emphasis. The proportion of a text- 
book — more precisely, the percentage of blocks into which the book has been partitioned — 
devoted to a specific topic is one indicator of the emphasis on that topic within a particular grade. 

This measure is especially meaningful for those countries that make consistent, extensive 
use of textbooks in their instructional and learning activities. Note, though, that the simple 
presence of material in a textbook does not definitely imply its use in a country’s classrooms, 
nor does it take into account any variations in that use. Textbooks can be — and in some coun- 
tries, often are — supplemented by additional materials from the teacher. Also some material 
included in the textbook may not be covered. However, the likelihood of coverage is higher 
when the material is present and less high when it is not. Thus, textbook data are useful in sug- 
gesting possible rough bounds on emphasis. This is especially true when attention is restricted 
to those topics that were treated in both the curriculum guides and textbooks of many countries, 
and that are thus of demonstrated importance to science education within a particular grade. 

This discussion focuses on the topics identified in chapter 6 as widely intended and both 
supported and emphasized by the corresponding textbooks of the upper grades of Populations 
1 and 2. For the upper grade of Population 1 these were ‘plants, fungi’ and ‘animals.’ For the 
upper grade of Population 2, ‘organs, tissues’ was the only topic that met the criteria. 

Figure 7.2 presents data on textbook space for the two commonly intended and emphasized 
topics in the upper grade of Population 1 . The cumulative proportion of textbook space in each 
country devoted to the topics clearly varied considerably among the countries. A large portion 




Figure 7.1 

Curricular Attention — Population 1. 

The share of curricular attention for each topic within each grade and country was computed. The index of comparative attention is pre- 
sented by one of the five symbols. They are for the upper grade of Population 1 for some widely intended topics in that grade and for all 
countries. This illustrates the variation typical of the data for all topics. 
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Figure 7.2 

Variations in Textbook Space for Two Commonly Intended Topics - Popnlation 1. 

The percentage of textbook blocks devoted to the two emphasized and widely covered topics at the upper 
grade for Population 1 is shown for each country. The variation in attention to these topics is obvious. 
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* The Notional Research Coordinators of Belgium have collected data only from curriculum guides. Due to the great level of detail of the guides and their extensive use, data from 

these are compared in this display with the textbook data supplied from all other countries. 

2 Ireland: Data applies to lower grade of Population 1. 

3 New Zealand: Since textbooks are not used in science instruction at this level, data are collected from teacher resource booklets. It is important to bear in mind that teachers use 
their own discretion in choosing units and topics to teach at this level. 

^ Although Scottish researchers made every effort to include data on a variety of textbooks that were deemed representative of textbooks in their country, their infrequent use in 

science education suggests caution when interpreting results. 

Missing Data: Germany, Lithuania, Sweden, and Tunisia. 
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of this material in virtually every country was devoted to ‘plants, fungi’ and ‘animals,’ although 
Denmark, Ireland, and Slovenia stand out as having devoted a particularly large proportion of 
space to these topics. Austria, Colombia, Portugal, Scotland, and French-speaking Belgium had 
comparatively little space devoted to these topics among the countries that included them. The 
relative proportion devoted to each topic also varied among the countries. Countries such as 
Flemish-speaking Belgium, Canada, Hungary, and Singapore devoted more space to ‘plants, 
fungi’ relative to ‘animals,’ — whereas the opposite was true for Denmark, Ireland, the 
Netherlands, and Slovenia. Overall, there is much diversity, with countries such as Denmark 
devoting more than 70 percent of the books to these two topics, whereas Iran, Colombia and 
Portugal devoted less than 5 percent to them. 

Figure 7.3 presents these data for ‘organs, tissues,’ the only commonly intended and empha- 
sized topic in the upper grade of Population 2. Clearly, considerable variation among the coun- 
tries in the emphasis was accorded this topic. Seven countries devoted more than 10 percent of 
their textbook blocks to this topic; most others devoted fewer than 10 percent of their textbook 
blocks to it. 

Variation in Emphasis in Textbook Topics for Physics Specialists 

The textbook content analysis was also applied to the physics specialist texts of TIMSS 
Population 3. Figure 7.4 presents the cumulative proportion of textbooks devoted to the six 
commonly intended topics previously identified for this population. Considerable intercountry 
variations in the amount of emphasis given to these topics exists. Some countries were unique 
in the level of emphasis given these topics — most notably New Zealand, Israel, and South 
Africa. Others (for example, Romania, Bulgaria, and Denmark) put comparatively little 
emphasis on these topics. Cyprus, Iran, and New Zealand are the only countries devoting more 
than 25 percent of their textbooks to ‘time, space, and motion,’ while Israel and New Zealand 
are the only countries devoting more than 25 percent to ‘wave phenomena.’ 




EMPHASIZED CURRICULUM TOPICS 



127 



Figure 7.3 

Variations in Textbook Space for ‘Organs and Tissnes’ - Popnlation 2. 

The life science topic of ‘organs and tissues’ is the single topic widely covered and emphasized in textbooks at 
the upper grade of Population 2. Here the percentage of textbook blocks devoted to this topic is shown for all 
countries providing data. Five countries devoted more than fifteen percent of textbook blocks to this topic; eight 
devoted fewer than five percent. 
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' Refer to footnotes in figure 7.2. 

Note: The following countries submitted data for Population 2 textbooks but did not cover this topic: Czech Republic, Denmark, France, Germany, Iran, and Lithuania. 
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Figure 7.4 

Variations in Textbook Space for Six Core Topics — Physics Specialists. 

Six topics — five of them in the area of energy and physical processes, one in the area of forces and motion — 
were widely covered and emphasized for the Physics Specialists of Population 3. The textbook block percentages 
for these four topics presented here show the extensive variation even in comparatively focused textbooks. 
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1 The National Research Coordinators of Belgium have collected data only from curriculum guides. Due to the great level of detail of the guides and their extensive use, data from 
these are compared in this display with the textbook data supplied from all other countries. 

Missing Data: Argentina, Austria, People's Republic of China, Dominican Republic, France, Germany, Italy, Latvia, Philippines, Portugal, Scotland, and Tunisia. 
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Notes 

' “Focus” and “coverage” were not precisely defined, but they provide at least rough indica- 
tions of curricular attention levels. 

^ Using this method, some topics within a grade and country could receive disproportionate 
shares of curricular attention; over all topics, however, this default “equal share” proportion 
of attention estimates the tme share across many topics. Note that, to avoid decimal frac- 
tions, the indices were multiplied by 10. 
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Chapter 8 

Other Aspects of the Curriculum: 

Performance Expectations and 
Disciplinary Perspectives 

Students are expected not only to gain the scientific knowledge discussed in the previous chap- 
ters, but also to think scientifically and do things with science content. These student perfor- 
mance expectations are central to countries’ curricular visions and intentions. They are a sec- 
ond, fruitful source for identifying shared, and different, curricular aims. Data on student per- 
formance expectations — on what students are expected to be able to do with science at par- 
ticular points in their schooling — were gathered from analysis of country curriculum guides 
and textbooks. These expectations are set forth in the second aspect of the Third International 
Mathematics and Science Study (TIMSS) science framework (see appendix C). 

Most of this chapter is devoted to exploring these student performance expectations. In 
addition, a brief section is included on the third TIMSS science framework aspect, disciplinary 
perspectives. This aspect covers broad perspectives on, perceptions of, and attitudes toward 
science — that is, what students are supposed to think or feel about science as a discipline. 
These data also were obtained from curriculum guides and textbooks; however, because many 
countries did not address this aspect in their curricular materials, the analysis is limited. 

Commonly Intended Performance Expectations 

To determine common performance expectations across countries, the units and blocks of 
the sampled curriculum guides and textbooks were coded according to the categories of the 
TIMSS science framework performance expectations. The most commonly intended perfor- 
mance expectations for the upper grades of Populations 1 and 2 are shown in table 8.1. The 
table lists the student performance expectations that were found in the curriculum guides for the 
indicated grade levels in at least 70 percent of the TIMSS countries. Topics found only in cur- 
riculum guides — without mention and support in the science textbooks for the grade level in 
question — are in the top pair of lists. Topics found in curriculum guides and supported by 
inclusion in the appropriate textbooks are in the middle pair of lists. Performance expectations 
included widely in textbooks (70 percent) but not included widely in the corresponding cur- 
riculum guides are in the final list. 
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The range of expectations for the upper grade of Population 1 was quite reduced and 
included some aspects of ‘understanding,’ ‘using tools, routine procedures, and science process- 
es,’ and ‘investigating the natural world’ — although the latter expectations were restricted to 
mention in curriculum guides without support in 70 percent of textbooks. If attention is restrict- 
ed only to those expectations in curriculum guides and supported by textbooks, the common 
expectations were even more limited, excluding all aspects of ‘investigating the natural world.’ 
Perhaps even more startling is that the only emphasized expectation was ‘understanding simple 
information.’' What appears to have been widely held intentions of developing a balanced array 
of expected performance abilities became more limited when textbook support was examined — 
rather than accepting the official intentions presented in curriculum guides alone — and became 
severely limited to ‘understanding simple information’ and when textbook emphasis was consid- 
ered. 

These data point to a clash of visions between the curriculum guides and textbooks of many 
countries. Although the curriculum guides cite some demanding expectations for Population 1 
students, the visions held by textbook makers were considerably less demanding as inferred from 
their products and were limited mostly to procedural knowledge. This is exactly the same situa- 
tion that was encountered in analyzing curriculum guides and textbooks in mathematics. 

This clash of visions was somewhat less for students in the upper grade of Population 2. 
The performance expectations of ‘conducting investigations’ and ‘interpreting data’^ that were 
in curriculum guides for the upper grade of Population 1 are now supported in textbooks. The 
performance expectations supported in textbooks in the upper grade of Population 1 continue 
to be supported in textbooks intended for the upper grade of Population 2. There are a number 
of performance expectations from the general categories of ‘theorizing, analyzing, and solving 
problems,’ ‘using tools, routine procedures, and science processes’ (all specific categories), and 
‘communicating’ that are called for by guides and supported by textbooks. On the other hand, 
only two performance expectations under ‘investigating the natural world’ are supported by 
textbooks: ‘conducting investigations’ and ‘interpreting data.’ The other three performance 

expectations under this general category, ‘identifying questions to investigate,’ ‘designing 
investigations,’ and ‘formulating conclusions from data,’ are mentioned in curriculum guides 
but they are not largely supported by textbooks, which seems to indicate again a more conser- 
vative set of expectations for student performances in textbooks than in curriculum guides. 

This conservative nature of textbooks is further evident when examining the two perfor- 
mance expectations that are emphasized in textbooks. These are ‘understanding simple infor- 
mation’ and ‘understanding complex information. Thus, even in a context of rich and varied 
demands presented in curriculum guides and supported by texts, the common emphases in text- 
books remained on more routine aspects of ‘understanding.’ The only progression in this regard 
between Population 1 and Population 2 is between understanding ‘simple’ information and 
understanding ‘complex’ information. 
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Table 8.1 

Commonly Intended Performance Expectations. 

Performance expectations indicated in the curriculum guides of 70 percent of TIMSS countries, 70 percent of 
countries' textbooks, or both are shown here. Those emphasized in textbooks (accounting for 6 percent or more 
of textbook blocks) are marked with an asterisk. These data are only for upper grades of Populations 1 and 2. 



Population 1 Population 2 

Curriculum Guides (Not in Textbooks); 

Investigating the NaturaiWorid Theorizing, Anaiyzing, & SoivingProbiems 

Conducting Investigations Making Decisions 

Interpreting Data 

Investigating the Natnrai World 

Identifying Questions to Investigate 
Designing Investigations 
Formulating Conclusions From Data 

Communicating 

Sharing Information 



Curriculum Guides (Included in Textbooks): 



Understanding 

Understanding Simple Information* 

Understanding Complex Information 

Using Tools, Routine Procedures, and Science Processes 

Using Apparatus, Equipment, Computers 
Doing Routine Experimental Operations 
Gathering Data 



Exclusively 



Understanding 

*Understanding Simple Information 
*Understanding Complex Information 
Understanding Thematic Information 

Theorizing, Analyzing, & SoivingProbiems 

Abstracting & Deducing Scientific Principles 
Applying Scientific Principles to Solve Quantitative Problems 
Applying Scientific Principles to Develop Explanations 
Constructing, Interpreting, & Applying Models 

Using Tools, Routine Procedures, & Science Processes 

Using Apparatus, Equipment, Computers 
Doing Routine Experimental Operations 
Gathering Data 

Organizing & Representing Data 
Interpreting Data 

Investigating the Natural World 

Conducting Investigations 
Interpreting Data 

Communicating 

Accessing & Processing Information 

in Textbooks: 



U sing T ools. Routine Procedures, «& Science Processes 

Organizing & Representing Data 



•Perfomance expectation emphasized in textbooks. 
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It is worth noting that the analysis of mathematics textbooks also uncovered an essentially con- 
servative approach to performance expectations in comparison to that present in curriculum guides. 

Variations in Intended Performance Expectations 

Even though the TIMSS countries held many student performance expectations in common, 
there was variation in individual country expectations as reflected in their curriculum guides 
(see table 18.2 in appendix I for data on all countries and table 8.2 in this chapter for represen- 
tative countries). Unweighted curriculum guide data indicate the presence or absence of spe- 
cific performance expectations. Some countries — for example, Greece — showed diverse, 
extensive expectations at the upper grade of Population 1 . In others — for example, Japan — 
the variety of expectations was considerably more restricted. 

More of the possible expectations from the framework were used in the upper grade of 
Population 2. For some countries — Canada and New Zealand, for example — a wide range 
of expectations was present at both grade levels. For Population 1, Flemish-speaking Belgium 
included all sub-categories from all performance expectations with the exceptions being ‘theo- 
rizing, analyzing, and problem solving’ and ‘communicating.’ However, it included the full 
range of all performance expectation categories for Population 2. Similarly, Ireland included 
some performance expectations (‘using tools, routine procedures, and science processes,’ 
‘investigating the natural world,’ and ‘communicating’) for Population 1 but a fuller variety for 
Population 2. For a few countries — for example, Greece and Spain — a more diverse set of 
Population 1 expectations was matched by a less diverse — or, perhaps better, more focused — 
set of Population 2 expectations. 

Variations in Textbook Emphasis of Performance Expectations 

Textbook data, although only a secondary reflection of curricular intentions, can be 
weighted to show relative emphasis. Thus, the percentage of a textbook’s blocks that were 
coded as covering a particular performance expectation indicate the emphasis on that 
expectation in that textbook. Aggregated to the country level, these data provide an indi- 
cation of relative emphases within a country and of variations among countries. These data 
are necessarily more diverse than the “presence versus absence” data from curriculum 
guides; they must be interpreted remembering that the roles and uses of textbooks differ 
among countries. 

Figure 8.1 presents the percentage of textbook blocks that included each performance 
expectation for the upper grade of Population 1 for selected countries. Corresponding data for 
the upper grade of Population 2 are presented in figure 8.2. Overall, although the degree of 
variation was high, the percentages for many categories were surprisingly low — which is a fur- 
ther reflection of the more conservative, less rich vision of student performance expectations 
typical of textbooks as seen in table 8.1. 
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The data for Population 1 present some interesting variations. ‘Understanding simple 
information’ represents from less than 20 percent of blocks in the textbooks of New Zealand 
and Flemish-speaking Belgium, to near 100 percent of blocks in textbooks from Greece. 
Regarding ‘gathering data,’ some countries have no blocks characterized by this performance 
expectation in their textbooks (as in Greece and Latvia), whereas other countries have a sizable 
amount of such blocks (as in Flemish-speaking Belgium and New Zealand). 

Data in this table corroborate the general finding of a more conservative set of performance 
expectations present in textbooks than in curriculum guides, similar to what was found for 
mathematics textbooks. Although curriculum guides appear to call for performance expecta- 
tions of ‘theorizing, analyzing, and solving problems’ and also ‘investigating the natural world,’ 
very little is present in textbooks to support them. There are some notable exceptions: Japan 
and Flemish-speaking Belgium appear to do quite a bit more in the area of ‘identifying ques- 
tions to investigate’ and New Zealand and Flemish-speaking Belgium in ‘conducting investi- 
gations.’ New Zealand is also noteworthy in the extent to which textbooks contain blocks 
focusing on the categories under ‘communicating.’ 

For Population 2, the conservative trend in textbooks appears even greater. What little was 
done in textbooks for the upper grade of Population 1 in ‘theorizing, analyzing, and solving 
problems’ and ‘investigating the natural world’ is largely no longer present in those textbooks 
intended for the upper grade of Population 2. For example, there are very few blocks on ‘iden- 
tifying questions to investigate’ in Japanese textbooks at this level, where these blocks had been 
more than 30 percent in the textbooks intended for the upper grade of Population 1. New 
Zealand textbooks at this level have about one-half of the percentage of blocks (17 percent) 
devoted to ‘conducting investigations’ than had been the case for the upper grade of Population 
1 (34 percent). This trend is particularly striking as the scientific content at this level is more 
complex and curriculum guides include a wider variety of performance expectations. 

It may be the case that this pattern is the result of the increased complexity of the subject mat- 
ter, making textbooks concentrate on the presentation of facts and explanations. In such a case, 
‘investigating the natural world’ might diminish in importance. All required laboratory manuals 
were included in these analyses. However, it may be precisely in the area of investigation where 
teachers are not relying on standard sets of materials that are the focus of this report. 

Variation in the percentage of blocks devoted to ‘understanding simple information’ is also 
quite high in textbooks for the upper grade of Population 2, ranging from 1 to 10 percent 
(Flemish-speaking Belgium) to more than 80 percent (Greece, Hungary, Ireland, and Norway). 

Relationships Between Performance Expectations and Content Topics 

To this point, performance expectation data have been considered independently of science 
topic. While performance expectations have been examined for individual countries and across 
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Table 8.2 

Variations in Performance Expectations. 

The presence or absence of each performance expectation is indicated for the upper grades of Populations 1 and 
2. These data are based only on curriculum guides. The data show that although common expectations existed 
across countries, they did so in a context of strong cross-national variations. 



Understanding 





Simple 


Complex 


Thematic 








Information 


Information 


Information 






Belgium (FI) 


1/2 


1/2 


1/2 






Canada 


1/2 


1/2 


1/2 






Czech Republic 


1/2 


1/2 
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*New Zealand: TIMSS analyses were based on data from the 1989 revised edition of the curricuium guides that were vaiid untii 1995. New guides were pubiished in 1993 and schoois 
were advised to work toward their implementation at the beginning of 1995. 
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Applying Scientific Principles... 


Constructing, 
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... to Develop 
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& Processing 
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Legend: 1 Present in the curriculum guide for the upper grade of Population 1 

2 Present in the curriculum guide for the upper grade of Population 2 
- Not present in either 








Figure 8.1 

Variation ofTextbook Use ofPerformance Expectations - Popnlation 1. 

The textbook bloek pereentages for various performanee expeetations are shown for the upper grade of Population 1 . The data are for all expeetations for a sample 
of countries. The data again show considerable variation. 
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Figure 8.2 

Variation ofTextbook Use of Performance Expectations - Popnlation 2. 

The textbook block percentages for various performance expectations are shown for the upper grade of Population 2. Similar variations as with Population I persisted at 
this level. 
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countries, performance expections are always examined for all science topics pooled. This sec- 
tion uses weighted textbook block data to determine whether certain types of student perfor- 
mances are more frequently expected than others when dealing with broad content categories 
or specific science topics. 

The performance expectation categories are slightly reorganized from those presented ear- 
lier into six broad categories to be used in the analyses below, using the intermediate framework 
levels of expectations — except in the case of ‘understanding’ for whieh ‘simple information’ 
and ‘eomplex information’ are retained (so little ‘thematie information’ was present that it was 
eliminated from eonsideration in these analyses). 

While it was neeessary to use textbook data to eompute weighted emphasis estimates for 
performanee expeetations, the seienee topies to whieh they were related in the analyses were 
either broad eontent eategories or speeifie topies indieated by eurrieulum guides as eommonly 
intended among the eountries and emphasized in textbooks. Even so, interpretation should 
always eonsider the differing roles of textbooks in different eountries, the seemingly more eon- 
servative vision of student expeetations eommon for textbooks, and the ehoiee of topies empha- 
sized rather than merely eovered. 

Figure 8.3 presents the distribution of the performanee expeetations eategories when deal- 
ing with ‘plants, fungi’ — one of the two eommonly intended topies for the upper grade of 
Population 1 that was both supported and emphasized by textbooks. How did the different 
eountries apportion their expeetations for what students should be able to do with this eontent? 
As shown, most eountries — for example, Colombia, the Russian Federation, and leeland — 
used a high level of ‘understanding simple information’ in this textbook material. In almost all 
eountries, this performanee expeetation aeeounted for more than 40 pereent of the textbook 
material on this topie — whieh is in aeeord with the more limited expeetations that seem typi- 
eal of what was emphasized in textbooks. There were some exeeptions to this expeetation — 
for example, in both Belgian systems, the Czeeh Republie, Singapore, Korea, and the Slovak 
Republie, the topie aeeounted for less than 20 pereent of the textbook bloeks. 

Very few eountries made use of ‘eommunieation’ expeetations (exeept, for example, the 
Dominiean Republie and Singapore), and with a few exeeptions — for example, Flemish- 
speaking Belgium, Japan, and Singapore — little use was made of expeetations related to 
‘investigating the natural world.’ Mueh of this material eommonly seemed to be based on sim- 
ple faetual knowledge rather than more eomplex performanees. A similarly high use of ‘under- 
standing simple information’ was seen for the next most widely intended and emphasized 
Population 1 topie: ‘animals’ (see figure 8.4). Notiee also that the pattern here is essentially 
the same noted for ‘plants, fungi’ (see figure 8.3). 

In figure 8.5, similar data are presented for the only textbook topie for the upper grade of 
Population 2 that was both eommonly intended and emphasized: ‘organs, tissues.’ Here it ean 
again be observed that the majority of the bloeks in most textbooks are devoted to ‘under- 




Figure 8.3 

Performance Expectations for ‘Plants, Fungi.’ 

The percentages of performance expectations in textbook blocks dealing with ‘plants, fungi ’ are presented for the upper grade of Population 1 . In almost all coun- 
tries, ‘understanding simple information’ accounted for close to 40 percent or more of textbook blocks. 
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Missing Data: Germany, Lithuania Sweden, and Tunisia. 






Figure 8.4 

Performance Expectations for ‘Animals. 
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1 Refer to footnotes in figure 18.1. 

Note: Two countries which provided Population 1 textbooks did not cover this topic: Cyprus and Israel. 
Missing Data: Germany, Lithuania, Sweden, and Tunisia. 
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Figure 8.5 

Performance Expectations for ‘Organs, Tissues.’ 

Data similar to those in Figure 8.3 are presented on the most common topic for the upper grade of Population 2. 
Again, greater emphasis is shown on ‘understanding simple information,’ although there is considerable more 
emphasis on ‘understanding complex infomation’ than had been the case with the most commonly covered top- 
ics for the upper grade of Population 1. 



UnderstandingSimple 

Information 
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information 
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& Solving Problems 
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Belgium (Fr)' 
Bulgana 
Canada 

China, People’s Rep. of 
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Percentage of Blocks 



' Refer to footnotes to Figure 18.1. 

Note: The following countries provided Population 2 textbook data but did not cover this topic: Czech Republic, Denmark, France, Germany, Iran, Lithuania, and Slovak Republic. 
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Figure 8.5 (continued) 

Performance Expectations for ‘Organs, Tissues.’ 
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1 Refer to footnotes to Figure 18.1. 

Note: The following countries: Czech Republic, Denmark, France, Germany, Iran, Lithuania, and Slovak Republic, provided Population 2 textbook data but did not cover this topic. 
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Standing simple information’ (Greece, Tunisia, and Scotland are good examples) or to a com- 
bination of this topic and ‘understanding complex information’ (such as the case of Austria, 
Bulgaria, and Korea). Only Colombia and Latvia show a sizable amount of ‘theorizing, ana- 
lyzing, and solving problems.’ French-speaking Belgium, the Dominican Republic, Japan, 
Norway, and Singapore are similar in that a notable amount of ‘investigating the natural world’ 
appears to complement the predominant expectation of ‘understanding.’ Singapore is unique in 
its combined emphasis on ‘investigating the natural world’ and ‘communication.’ 

Performance Expectations for Physics Specialists 

The analyses conducted for the upper grades of Populations 1 and 2 were also performed 
for the physics specialists in Population 3. Table 8.3 is the Population 3 physics specialist coun- 
terpart of table 8.1. 

What was expected of these students was more diverse. Curriculum guides included perfor- 
mance expectations from all categories with the exception of ‘communicating.’ Although cur- 
riculum guides call for investigating the natural world through ‘conducting investigations’ and 
‘interpreting data,’ these expectations are not commonly supported in textbooks. It is important 
to note that countries coded required laboratory manuals, and it is therefore unlikely that these 
expectations lie in other commonly used documents not analyzed. However, it is also more like- 
ly that teachers themselves, through optional ancillary materials and other instructional practices, 
may be implementing performance expectations mentioned in guides yet only marginally sup- 
ported to a substantial degree in textbooks. What textbooks do emphasize at this level appears to 
be the understanding of factual information and the solving of paper and pencil exercises. Again, 
as was the case for the upper grades of Population 1 and 2, textbooks appear to be more conserv- 
ative in the performance expectations they contain than were curriculum guides. 

Figure 8.6 presents textbook proportion — and thus variation — data for a selection of indi- 
vidual countries (see appendix I, figure 18.6 for all countries). In general, many countries 
emphasized ‘understanding’ — especially the United States and, to a lesser extent, Australia and 
Canada. Some notable exceptions were seen as well — for example, the Russian Federation’s 
and Spain’s notable emphasis on ‘constmcting, interpreting, and applying models.’ Switzerland 
was unique in having more than 11 percent of blocks devoted to ‘conducting investigations.’ 
Some countries devoted much less space to quantitative problem solving (the Russian 
Federation, the United States, and Australia) than others (Canada, Greece, Japan, and Spain). 
Textbooks remained less varied and less demanding than did curriculum guides. 

Perspectives 

Many textbooks and curriculum guides contained broad-based statements about the nature 
of scientific habits of mind, the everyday uses of science (presumably included to increase stu- 
dent interest), careers in fields that made use of the sciences, and attitudes towards science and 
its importance. In TIMSS, these perspectives were formed into a set of six categories. 
Sampled curriculum guides and textbooks were coded for their direct use of these perspectives. 
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Table 8.3 

Commonly Intended Performance Expectations — Physics Specialists. 

The perfomance expectations indicated in the curriculum guides of 70 percent of TIMSS countries, 70 percent of countries' 
textbooks, or both are shown here. Expectations emphasized in textbooks (that is, accounting for 6 percent or more of text- 
book blocks) are marked with an asterisk. These data are only for materials related to the Physics specialists of Population 3. 

Populations 

Curriculum Guides (Not in Textbooks): 

Using Tools, Routine Procedures, and Science Processes Investigating the Natural World 

Using Apparatus, Equipment, Computers Conducting Investigations 

Doing Routine Experimental Operations 
Gathering Data 

Organizing and Representing Data 
Interpreting Data 

Curriculum Guides (Included in Textbooks): 

Understanding 

Understanding Simple Information* 

Understanding Complex Information* 

Theorizing,Analyzing, and Solving Problems 

Abstracting and Deducing Scientific Principles 

Applying Scientific Principles to Solve Quantitative Problems* 

Applying Scientific Principles to Develop Explanations 

Exclusively in Textbooks: 

Theorizing,Analyzing, and Solving Problems 

Constructing, Interpreting, and Applying Models 

•Perfomance expectation emphasized in textbooks. 






Figure 8.6 

Variations in Textbook Use of Performance Expectations — Physics Specialists. 

The textbook block percentages for various performance expectations are shown for books used by the physics specialists ofPopulation 3. 
The data are shown for all performance expectations but for a representative selection ofcountries. Ageneral emphasis on understanding 
simple and complex information was seen inmany countries as well as considerable emphasis on solving quantitative problems. 
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Table 8.4 

Variations in Perspectives. 

The presence or absence of each perspective is indicated for the upper grades of Populations 1 and 2. These data are based on 
curriculum guides. Use of perspectives was common in many of these documents. 
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Figure 8.7 

Variation of Textbook Use ofPerspectives - Population 1. 
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Figure 8.8 

Variations in Textbook Use ofPerspectives - Population 2. 

Data similar to those in the previous table are shown but for the upper grade of Population 2. 
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A substantial proportion of direct statements were made in curricular documents about these 
matters in many countries. This finding is in marked contrast to what was found in mathemat- 
ics. Some countries, such as Australia and the United States, included all of the perspective sub- 
categories in their curriculum guides. Other countries, for example Canada, Israel, and Tunisia 
used at least some of the sub-categories from all six major categories of perspectives in the sci- 
ence framework in both the upper grades of Population 1 and 2. 

Table 8.4, figure 8.7, and figure 8.8 display the results of this analysis of perspective data. 
Table 8.4 covers data based on curriculum guides for the upper grades of Populations 1 and 2; 
the figures show textbook emphasis of perspectives. Emphasis on ‘positive attitudes towards 
science, mathematics, and technology’ was prevalent in Denmark, France, Latvia, Iran, and the 
Russian Federation in Population 1, although this emphasis practically disappears in Population 
2 (the most notable exception is Germany). The perspectives present in textbooks intended for 
the upper grade of Population 2 shift mostly to ‘science, mathematics, and technology to 
increase interest.’ Latvia and, to a lesser extent, Flemish-speaking Belgium and the Philippines 
are notable for their inclusion of a higher proportion of blocks devoted to ‘scientific and math- 
ematical habits of mind’ than was the case in other countries. In South Africa, this perspective 
was emphasized in the upper grade of Population 1 more than in other countries. In the case of 
the Philippines, higher relative emphasis on this performance expectation was a characteristic 
of textbooks for the upper grades of both populations. 
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Notes 

1 ‘Understanding simple information’ is a eategory from the performanee expeetation aspeet 
of the TIMSS seienee framework that refers to understanding information sueh as voeabulary, 
faets, equations, and simple eoneepts. Examples of performanees of this type are defining, 
deseribing, naming, quoting, reeiting, ete. 

2 The framework eategory ‘interpreting data’ ineludes extrapolating or interpolating data 
from a table or graph, identifying patterns or trends in data, ete. 

3 The eategory ‘understanding eomplex information’ refers to understanding information 
involving the integration of bits of simple information. Examples of performanee that eould 
indieate eomplex information are differentiating, eomparing, eontrasting, and synthesizing. 
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Chapter 9 

Re-examining Shared Visions: Country Groupings 

The preceding chapters have looked at curricular intentions across all participating countries. 
From this analysis, we see broad-based commonalities and diversities. These findings, howev- 
er, mask myriad similarities and differences among countries. In an effort to delineate some of 
them, this chapter examines data for various groupings of countries. The patterns that emerge 
from these groupings yield interesting insights regarding shared curricular visions. 

In undertaking this analysis, the central decision involved determining the sets of countries 
to investigate. Some possibilities were obvious — for example, examining the countries of var- 
ious geographic regions, various economic categories, and various pre-existing market confed- 
erations such as the G-7 countries, the countries of the Organization for Economic Co-opera- 
tion and Development, and European Union countries, etc. A radically different approach was 
to start not with groups of countries defined by pre- determined criteria, but rather to use statis- 
tical methods to cluster countries into groups and then to examine commonalities among them. 
This last approach could reveal interesting similarities in curricular intentions across unexpect- 
ed groups of countries. All four of these grouping methods: geographic, economic, market- 
based, and statistical were applied in this analysis. 

In the interests of space and time, this first analysis focused only on content in the narrow 
sense. Specifically, only textbook coverage of science framework topics was considered, as 
measured by the percentage of textbook blocks devoted to various content topics was consid- 
ered for the upper grades of Populations 1 and 2. Other interesting approaches, including con- 
sideration of the physics specialists of Population 3, are deferred to later reports. While the data 
selected have certain limitations (discussed earlier), their variability make them more useful 
than other data (such as curriculum guide data). Obviously, what follows should be considered 
suggestive of, rather than conclusive for, inferences about curricular visions and intentions. 

Countries Grouped by Geographic Region 

The most obvious criterion for grouping countries is geographic region. Neighboring or 
nearby countries often share traditions, cultural similarities, and historical interactions. They 
may have a history of — or an interest in — mutual comparisons, or may have a more direct 
economic competitiveness. They also might share common curricular traditions. 
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There are many ways of assigning regional eategories to the various eountries ineluded in 
this study. The grouping used in this analysis is based on a reeognition that partieipation in the 
Third International Mathematies and Seienee Study (TIMSS) was not uniform aeross the world. 
This grouping* eomprises eight regions as generally determined by geographie, historie, and 
eultural proximity: 

• Latin Ameriea (Spanish-speaking); 

• Australia and New Zealand; 

• East Asia; 

• Western Europe; 

• East and Central Europe; 

• United States and Canada; 

• North Afriea and the Middle East; and 

• South Afriea.2 

Table 9.1 shows the average pereentage of textbook bloeks devoted to eaeh of the interme- 
diate eategories of the seienee framework for the upper grade of Population 1 by the geograph- 
ieal regions outlined above. Table 9.2 does the same for the upper grade of Population 2. 

One area of differenee was in the attention devoted to ‘earth features’ topies — a eentral 
group of topies in Population 1 — and to sub-topies in the life seienees. The textbooks of eoun- 
tries grouped as East and Central Europe indieated almost twiee the textbook eoverage of ‘earth 
features’ at this level than did those of the United States and Canada and Western Europe, and 
both of these regions devoted eonsiderably more attention to this topie than the others. 

The group of Middle East/North Afriean eountries were remarkable in the extent to whieh 
the physieal seienees were emphasized, as were Australia and New Zealand. Topies sueh as 
those ineluded in ‘energy and physieal proeesses’ were not emphasized as mueh in the other 
regions. 

There were other variations for the upper grade of Population 2 (see table 9.2). Canada and 
the United States and South Afriea emphasized ‘earth features’ in the upper grade of Population 
2 more than other regions. Eife seienees were emphasized by the Eatin Ameriean and Middle 
East/North Afriean regions, with Eatin Ameriea devoting more attention to ‘diversity, organi- 
zation, stmeture of living things’ than other regions. 

There are interesting regional variations in the emphasis on physieal seienee topies. In 
Eatin Ameriea, mueh more emphasis is given to topies in ‘forees and motion’ than in any of the 
other regions. ‘Energy and physieal proeesses’ is emphasized more in the textbooks of East and 
Central Europe. 
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Table 9.1 

Topic Coverage in Eight Regions - Popnlation 1. 

These data are the average percentage of textbook blocks for each science topic averaged over the countries in one 
of eight regions. They are only for the upper grade of Population 1. Notable variations among regions occur in the 
areas of ‘energy and physical processes,’ ‘diversity, organization, structure of living things,’ and ‘earth features.’ 
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Table 9.2 

Topic Coverage in Eight Regions — Popnlation 2. 

These data are similar to those in the previous table but are only for the upper grade of Population 2. In addition 
to regional variations on some of the same topic areas as noted for Population 1 in table 9.1, a variety of earth, 
life, and physical science topics present noteworthy regional variation. 
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Countries Grouped by Economic Category 

Economic considerations might have some impaet on seienee eurrieula. To diseern this 
impaet, eountries were grouped by average ineome. Using the World Bank’s World Tables 
1995, eountry ineomes were eategorized in four ways: 

• low — having a per eapita gross national produet (GNP) of US$695 or less in 1993; 

• lower middle — a per eapita GNP between US$695 and US$2,785 in 1993; 

• upper middle — a per eapita GNP between US$2,785 and US$8,626; or 

• high — a per eapita GNP greater than $US8,626^. 

The low-ineome group was represented by only one eountry — the People’s Republie of 
China. Thirteen eountries were represented in the lower middle eategory, 8 in the upper mid- 
dle, and 23 in the high-ineome eategory. Exeept for the low-ineome group, this representation 
seems suffieient for substantive eontrasts. Notiee that per eapita GNP is used here only as an 
indieation of eomparative wealth and not as a direet indieator of edueational opportunity. 

Table 9.3 presents the average pereentage of textbook bloeks devoted to eaeh of the seienee 
framework topies for the upper grade of Population 1 for the four ineome eategories outlined 
above. The most striking observation here is how few distinetions exist at the Population 1 
level. Among these eountries, the high-ineome group did less with ‘earth features’ than the 
middle-ineome groups. The upper middle-ineome group did less with ‘energy and physieal 
proeesses’ than was the ease in the other middle-ineome group and the high-ineome group. 

There were more variations in topie eoverage by ineome group for the upper grade of 
Population 2 (see table 9.4). The high-ineome group paid somewhat less attention to ‘strueture 
of matter’ than the lower middle-ineome group. ‘Energy and physieal proeesses’ reeeived more 
attention from the lower middle-ineome group. 

In some ways, the results of these analyses are surprising. It would appear that grouping 
eountries on geographie eriteria uneovers more striking eontrasts than grouping them by 
ineome. Although it may be our hope that ineome not affeet the quality and variety of eduea- 
tional opportunities that eountries ean make available to students, other evidenee suggests that 
this is not tme. It is a simple faet in seienee edueation that some pedagogieal strategies are more 
expensive than others, a faet that has been reeognized for some time by organizations sueh as 
the World Bank. 

By the results reported here, however, this hard truth is not evident in topies eovered. 
However, future analyses will examine this issue from the perspeetive of performanee expeeta- 
tions and bloek types. Praetieal aetivities in the seienees are partieularly expensive, for exam- 
ple, whieh implies they might be used with more or less frequeney in different eountries aeeord- 
ing to their eeonomie eireumstanees. Future work will attempt to diseover whether the intend- 
ed eurrieulum of TIMSS eountries vary in performanee expeetations for seienee aeeording to 
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Table 9.3 

Topic Coverage for Four National Income Groups — Population 1. 

These data are the average percentages of textbook blocks for each science topic averaged over the countries in 
four national income groups (determined by World Bank criteria and data). They are for the upper grade of 
Population 1 only. 
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Table 9.4 

Topic Coverage for Four National Income Groups — Population 2. 

These data are similar to those for the previous table, but are only for the upper grade of Population 2. 
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their economic circumstances — reflecting the need to limit particularly costly pedagogic 
strategies in countries with less resources. 

Countries Grouped by Market Group Category 

A third approach to grouping countries was by “market groups” of close economic blocks. 
These groups may not have always shared common traditions or regional similarities, but they 
do have a special interest in cross-national comparisons of educational productivity and other 
related educational system factors of the countries of their market group. One such grouping is 
considered here — the European Union (EU) countries versus other countries. Of the 15 cur- 
rent EU members, 12 are represented in these data; only the United Kingdom, Finland, and 
Euxembourg are not. 

Differences in textbook coverage of science framework topics for the upper grade of 
Population 1 in EU countries versus non-EU countries were few. On average, EU countries had 
less textbook content in ‘energy and physical processes’ topics. They did more with ‘diversity, 
organization, structure of living things.’ 

The differences for the upper grade of Population 2 were neither particularly numerous or 
strong. The other countries did somewhat more with ‘life spirals, genetic continuity, diversity’ 
than did the EU countries. 

Countries Grouped Statistically 

A quite different approach to investigating similarities in limited country groups was to 
cluster countries by their data. Here the country clusters were likely to be more diverse than 
the other groupings; in fact, they might only have some content emphases in common. For this 
reason, the investigation focused primarily on which topics formed the basis for similarities. 
This focus differs somewhat from that of the preceding analyses; there, we looked at both the 
degree and type (content) of differences; here, attention is focused solely on the content sources 
of differences. 

Based on separate statistical clustering of Population 1 and Population 2 (upper grade) text- 
book data, two sets of clusters (one set for each population) emerged that shared major simi- 
larities in content coverage. In addition, certain countries among each population — Cyprus, 
Iceland, Iran, Israel, and the Philippines in Population 1 ; Denmark, the Dominican Republic, 
and Israel in Population 2 — revealed such distinctive content patterns that it seemed better not 
to group them in any of the clusters. (It is worth noting that mathematics curricula in the 
Dominican Republic and Israel were also so distinctive that they were excluded from the clus- 
ters made for the analyses of mathematics curricula.) 

For the upper grade of Population 1, strong differences were seen only for a few topics (see 
table 9.5). ‘Eand forms’ and ‘bodies of water’ separated the clusters into groups, as did relative 
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emphasis on topics related to ‘diversity, organization, structure of living things,’ ‘interactions of 
living things,’ and some topics in the physical sciences. The cluster of Colombia, New Zealand, 
and Scotland, for example, was distinguished by much attention to ‘electricity’ and ‘physical 
properties of matter,’ and less attention to ‘bodies of water,’ ‘human biology and health,’ and 
‘organs, tissues’ at this level. 

A more diverse set of topics formed the basis for clusters in Population 2, as seen in table 
9.6. ‘Energy types, sources, conversions’ helped separate some clusters. ‘Light’ and ‘electric- 
ity’ also made contributions to differences. ‘Classification of matter’ was less important in this 
regard. Emphasis on ‘weather and climate’ and on ‘earth in the solar system’ helped to distin- 
guish the cluster formed by Iran and South Africa. Degree of emphasis on ‘electricity’ was the 
single most distinguishing feature of the cluster of countries formed by the Czech and Slovak 
Republics, France, Japan, Korea, Romania, and Slovenia. 

The statistical clustering of countries created interesting groups for further exploration of 
similarities. At first glance, these groups appeared quite disparate, and their clustering was not 
easy to interpret. However, what clearly emerges from this approach is that there are large dif- 
ferences among clusters on key topics. The magnitude of these differences prove that there 
were strong intercountry differences on these topics — the pooled intercountry variance on a 
few topics was sufficient for groups of countries to be easily distinguished. In this context, it 
is noteworthy that the traditional basis for grouping — geographic region, economic factors, 
market and political affiliations — revealed cross-national differences only by an accumulation 
of many diverse, yet small, topic differences. The traditional a priori groupings tried here did 
not uncover key topic variances of magnitude in distinguishing groups. Statistical approaches 
did not reify a priori groupings — traditional factors simply were not as effective in revealing 
content distinctions in this case. 
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Notes 

' Countries were assigned to the following regions: Latin Ameriea (ARG, COL, DRP, MEX); 
Australia and New Zealand; East Asia (CHN, HKG, JPN, KOR, PHE, SGP, THA); Western 
Europe (OST, BEE, BFR, CUP, DNK, FRA, DEU, GRC, IRE, ISE, ITA, NED, NOR, PRT, 
SCO, ESP, SWE, SUI); East and Central Europe (BGR, CSK, HNG, EVA, ETU, ROM, 
RUS, SVK, SVN); the United States and Canada; South Afriea; and North Afriea and 
Middle East (IRN, ISR, TUN). See appendix F for a list of the eountry abbreviations. 

2 The eomposition of these latter two regions was dietated primarily by the low representa- 
tion of Afriean and Middle Eastern eountries in TIMSS. 

3 Countries were assigned to the following groups in aeeordanee with the “elassifieation of 
eeonomies by ineome” in the 1995 issue of the World Bank’s World Tables: Eow Ineome 
(CHN); Eower Middle Ineome (PHE, THA, BGR, CSK, EVA, ETU, ROM, RUS, SEV, IRN, 
TUN, COE, DRP); Upper Middle Ineome (SAP, KOR, HNG, SVN, GRC, PRT, ARG, 
MEX); and High Ineome (AUS, JPN, NZE, HKG, SGP, OST, BEE, BFR, DNK, FRA, 
DEU, ISE, IRE, ITA, NED, NOR, ESP, SWE, SUI, CUP, ISE, CAN, USA). See appendix 
F for a list of the eountry abbreviations. 
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Chapter 10 

Concluding Remarks 

The analysis presented in this monograph represents a first attempt to examine and eompare the 
eurrieular aims of the eountries partieipating in the Third International Mathematies and Seienee 
Study (TIMSS). Several pervasive eonelusions were identified during this effort and they are 
summarized in this ehapter. Also, sinee the eurrieulum data gathered are eomplex and the results 
presented here are only from a first set of investigations, we outline some direetions for future 
eurrieulum analysis work. 

A Few Broad Conclusions 

Pervasive Variation 

The preeeding ehapters repeatedly presented examples of pervasive and detailed eross- 
national variation. Variation was pervasive, oeeurring among eountries and topies in myriad 
ways both small and large. Commonalities always oeeurred against this baekground of varia- 
tion among topies and eountries. Variation was also detailed, oeeurring at virtually every level 
of detail. Important eommonalities — both broad and, at times, speeifie — were found by 
examining topies aeross eountries, eountries aeross topies, or both. However, at whatever level 
eommonalities were found, the details at that level always varied both among eountries and 
among topies. 

While it is perhaps premature to generalize from the TIMSS data, it seems unlikely that data 
gathered from detailed, empirieal analyses of eurrieular materials, edueational materials, or 
eross-national testing will ever be found free of similar detailed, pervasive variation. This eli- 
mate of variation is the elimate of large-seale empirieal investigations into aspeets of national 
edueation systems and their aetivities. A study that does not find or does not take into aeeount 
sueh variation seems suspeet and would seem to merit eareful diseussion of why sueh variation 
did not oeeur or was not eonsidered. 

The Importance of Context in Interpreting Findings 

Cross-national edueational eomparisons are based on finding signifieant similarities and 
signifieant differenees. While it is tempting to see detailed variation as “noise” and only 
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broad similarities and major differences as “signal” or “message,” such distinctions may be 
difficult — if not impossible — to make when data have been oversimplified or their context 
has been ignored. 

All comparative data must, therefore, be presented within a context of variation. This con- 
text must be carried throughout the analysis and summarized appropriately when stating find- 
ings. Cross-national comparisons of educational systems and their science education activities 
are intended to provide information on curricula, educational systems, national goals, and how 
well national goals are being met. Analytic comparisons are only meaningful if they are based 
on factors sensitive to the effects of curriculum and educational systems, and relevant to nation- 
al goals in science education. Sensitive comparisons considered apart from this context are 
unnecessarily simplified and the validity of these results is necessarily suspect. 

Weaknesses of A Priori Comparisons 

Comparative educational research has often uncovered important educational differ- 
ences between countries grouped according to geographic, economic, or other criteria. 
However, such a priori groups only served to uncover some differences in the curricular 
factors investigated here. 

The groups formed by rational, a priori criteria (which were discussed in chapter 9) differed 
primarily by the cumulative effect of many small differences among content topics and curric- 
ular emphases, rather than marked differences among a few topics. It is here that the statistical 
clustering reported has a special significance. Such statistical clustering, by the very nature of 
the analysis employed, maximizes the distinctions among groups of countries. The topics iden- 
tified by such analyses and the size of the differences among the clusters are essentially as large 
as can be obtained from the variation that exists in the data. 

In this sense, the statistical clustering suggests two conclusions: 

• There are some topics where marked variation can be found when the basis for forming 
groups of nations is allowed to range freely to take into account as much as possible the 
cross-national variation that occurs. However, the national groups identified in this way 
bear little resemblance to the a priori groups. 

• Grouping nations by those a priori criteria considered was less effective in revealing the 
meaninglul stmcture of similarities and differences inherent in the variation of the orig- 
inal data. This may be tme because the most appropriate a priori criteria have yet to be 
identified and investigated. Nonetheless, it may well be that the groups formed by a pri- 
ori logical or rational criteria for cross-national comparisons of science curricula may 
provide only for the simple accumulation of small differences. In this case, further 
study — rather than further attempts at alternative grouping criteria — is needed to 
explain more meaningful and substantive similarities and differences. 
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Possibilities and Limitations of Large-Scale Document Analysis 

The TIMSS curriculum analysis effort and, in particular, its document-based data collection 
and analyses, was not merely a feasibility study for such cross-national analyses on a large 
scale. These activities were a serious first attempt at large-scale document analysis and were 
intended to yield useful results. However, they were also a feasibility study of the possibilities 
and limits of large-scale curriculum document collection and analysis. 

Large-scale cross-national curriculum comparisons previously have relied mostly on sur- 
veys and expert data. Analysis of curricular documents has typically been reserved for smaller 
scale studies with limited comparisons, often those with a case study approach, as much quali- 
tative as quantitative. The present investigations suggest that document-based data gathering 
and analyses are feasible on a large scale and can yield useful data. Revealing data can be col- 
lected without translation of entire documents. The data collection can be sufficiently detailed 
for quantitative analyses. While case studies are useful sub-analyses even in the context of this 
larger scale approach, analysis of curricular documents is not inherently limited to case studies. 

On the other hand, these investigations have shown how demanding such research is. The 
cost in time, personnel, and other resources certainly increases more than linearly with increas- 
es in the scope and scale of curriculum document collections and analyses. The sort of statis- 
tical abstracts of documents seemingly necessary for document analysis on such a scale requires 
careful prior design for (1) data collection constructs and methods, since the abstracting process 
will limit analytic possibilities, and (2) procedures to ensure and assess data reliability and 
validity. The decisions made in planning the TIMSS collection permitted certain kinds of 
analyses and eliminated others. TIMSS also showed some of the magnitude involved in data 
quality assurance and in assessing reliability and validity in the analysis of documents coded by 
national teams without full translation into a common language. 

Future Directions 

Future Planned Investigations 

The TIMSS curriculum data are tremendously detailed and extensive; this monograph 
reports the very first steps of the analyses that can and will be performed using these data. For 
example, planned investigations will cover the structure of textbooks and the relation of text- 
book form and function. Also, future monographs will report more fully on the science cur- 
riculum and on the relation of the science and mathematics curricula. 

As the full sets of TIMSS curriculum data, survey-based data (for schools, teachers, and stu- 
dents), and achievement test results become available, analyses will be made to relate intention, 
implementation, and educational attainments. The initial focus will be on cross-national com- 
parisons. However, the TIMSS curriculum data have shown how extensive intracountry varia- 
tion is among participating countries. Further studies are needed to investigate intracountry 
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variations in nations with regional and other sub-national edueational systems and varying sei- 
enee eurrieula. Also, studies of nation group eomparisons — as opposed to eomparisons aeross 
the whole set of eountries — have barely begun. Further investigation is needed of limited eoun- 
try groups to find substantive similarities related to national and edueational system faetors. 

Additional Data Needs 

Although ambitious, the TIMSS data eolleetion effort revealed important omissions in its 
design resulting from neeessary tradeoffs and resouree limitations in planning the eolleetion. 
To address these omissions and enhanee the value of the existing TIMSS data, at least small- 
seale supplemental data eolleetions are needed. Examples of information that would fill in gaps 
and be highly useful in future TIMSS analyses inelude the following: 

• Direet information on sequenee and topie emphasis; 

• Doeuments other than eurrieulum guides and textbooks — for example, annotated 
teaeher textbooks and national examinations; 

• Determination of the differing role and funetion of textbooks among nations and eross- 
national differenees in that role; and 

• More detailed information about eurrieulum guides. 

Secondary Analyses of Existing Data 

Meehanisms are in plaee for more extensive analyses of the existing TIMSS data, espeeial- 
ly the eurrieulum data. These primary analyses will eertainly not exhaust the possibilities of the 
data and their interrelationships. As time and resourees permit, the data will — upon eomple- 
tion of the primary analyses — be made available for seeondary analyses. Doeumentation must 
be provided for the extensive database, as well as provisions made for sharing a data eolleetion 
of this massive size. The eorresponding original eurrieulum doeuments are also arehived and 
will be made available for future analyses. 

New Methodologies 

The volume and eomplexity of the TIMSS data ehallenge the existing state of the art in edu- 
eational researeh methodologies. They point up the need for newer analytieal methods. We 
have here applied one set of eurrieulum analysis methods to this large data eolleetion. Other 
newer, and more penetrating, analytie methods should provide additional insights. 
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A Final Remark 

The findings and conclusions presented in this monograph are only a beginning. More is 
planned for primary analyses of the TIMSS data; more still should result both from eventual 
secondary analyses and further data collections suggested by these analyses. The purpose of 
this report is both to answer some persistent questions and to raise some new questions. 
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Appendix A 

Curriculum, Experience, and Opportunity 

This appendix details the theory — presented briefly in chapter 1 — of curriculum and its rela- 
tion to actual student experiences. This theory informs the view of curriculum used throughout 
most of the analyses presented in this monograph. 

Experience and Intentionality 

Directly shaping students’ educational experience is to some degree problematic. Given 
this reality, does it even make sense to speak of curricular intentions — of guiding visions and 
aims shaping curricular activities? Common sense and educational practice certainly say “yes.” 
Even with students’ experiences as curriculum building blocks, there is room for “builders” — 
those who act deliberately and with intention — to affect those experiences. There must always 
remain a fundamental sense in which individual experience is not malleable. However, if that 
were the final story, there would be no room for the study of curriculum or the practice of 
schooling. 

The history of goal-driven group educational attainments makes it clear that much of what 
guides educational experience is alterable. For a category of students (participants in a specif- 
ic educational system, of a similar age, and so on), similar opportunities (backgrounds, educa- 
tional settings, tasks, activities, materials, and involvement) typically lead to similar education- 
al attainments. In specific situations, educational attainments are comparatively predictable, 
and the distribution of such attainments is often relatively narrow for similar students. If this 
is so, a reasonable inference is that the experiences of individual students lying behind specif- 
ic attainments are shared, common experiences. Thus, given that it is sensible to speak of 
approximately common experiences, it seems reasonable also to examine those manipulable 
elements that help to produce them. These elements (activities, materials, etc.) are the creations 
that reflect the intentions of those who made them. 

The present volume considers curriculum only in its more narrow, policy-malleable aspects. 
Curriculum is intentional and related to students’ experiences in schooling. The aims and inten- 
tions of policy- and curriculum-makers articulate visions and seek to guide experiences. They 
impose authority and “[bring] order to the conduct of schooling.” ‘ This volume is, then, in part 
a study of how curriculum orders students’ experiences in schooling and of the structures 
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imposed by formal authorities in a variety of national edueational systems. It does not exam- 
ine the direet meehanisms for imposing sueh order — a task left for later volumes reporting this 
study. Rather, it examines some sets of eurrieular data and materials (eurrieulum guides and 
textbooks) for patterns of refleeted intentions and for eommonalties and diversities of order 
refleeted in materials from various edueational systems. It also investigates what may be 
inferred about common and differing intentions. 



Opportunity and Potential Experience 

Further clarification of the relationship between curricular experiences and educational 
opportunity may be needed. Students’ experiences are here considered as a matter of individ- 
uals’ interior lives. Teachers may help create and shape experiences, but students’ actual expe- 
riences are combinations of activity and setting — of opportunity or “potential experiences” — 
and of children’s participation and engagement in those activities. This combination of oppor- 
tunity, engagement, and those engaged determines the actual experiences flowing from encoun- 
ters with potential experiences. Those guiding educational systems plan the creation and dis- 
tribution of educational opportunities. Teachers shape specific opportunities — settings, activ- 
ities, and their short-term sequences. Students reshape opportunities by their perceptions and 
reactions - acting as the final arbiters in creating their own experiences. It is out of those actu- 
al experiences that learning occurs, and it is this learning that achievement tests measure. 

Remembering this, curriculum should not be seen as directly managing and ordering stu- 
dents’ experiences, especially when educators are considered to express intentions through cur- 
riculum guides and textbooks (and other curricular materials). Articulating visions and aims 
and planning the creation and distribution of desired common potential experiences are only the 
first stages of the varied tasks of devising curriculum. Later stages must follow — steps taken 
by teachers and students. One may judge the outcome of the first phases only by considering 
the entire result — both the vision and final outcomes. Even as the curriculum policymakers 
map the domains, topics, performances, etc., of intended experiences, providing intended 
sequences of those experiences, students must interact with those intentions as teachers imple- 
ment and shape them. Many factors help determine how similar the curriculum as experienced 
by students is to the intentions of educational policymakers. It depends at least on the detail 
and clarity of the goals and plans, on the difficulties that the system inadvertently creates along 
the way, and on the resources available to teachers and students. While this study is about how 
national intentions are communicated and used to help guide students through the course of 
their studies, acts of curricular intentionality are worth investigation in themselves. As they 
help to determine the futures of students, these first stages — these goals and sequences of 
intended student experiences — must be investigated. 

One must remember the indirect nature by which “desired’ common experiences are sought 
in the pursuit of educational aims and curricular intentions. This seems best done by use of a 
more indirect term — such as opportunity — for that which is directly manipulated by 
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educational policies and by curricular materials (especially, curriculum guides and textbooks). 
Opportunity is used only to maintain in the foreground this essential indirectness in shaping stu- 
dents’ experiences. It is an expression of “desired” and “potential” experiences that, in the end, 
can be shaped only partly but not determined completely. 

Opportunity for some is a highly polemical word that, when coupled with the word educa- 
tion, often has political connotations associated with a complex set of values regarding equali- 
ty and other social norms. Some consider any statement that implies a failure to provide an 
opportunity as an indictment of educational practice. However, since students’ time for school- 
ing is limited, which, in turn, limits the numbers of activities and settings, educational oppor- 
tunity also is limited — in economic terms, it is a “scarce” resource. Every choice shaping 
schooling provides some opportunities at the expense of others. The opening tasks of curricu- 
lum-making involve using vision and insight to define, choose, and sequence opportunities. 
National choices are clearly the concerns of individual nations (and systems) — matters of their 
particular visions — considered as made with the intention of serving well both the nation and 
its children. 

Common opportunities — potential experiences — rather than common experiences, are a 
much more conservative basis for discussing curricular aspects that can be “charted” — intend- 
ed, guided, and ordered. This volume considers curriculum only in its role of distributing 
potential experiences and intending to aid the management of sequences, patterns, and arrays 
of opportunities. It uses only language of description, not of judgment. Those wishing a more 
detailed look at this volume’s underlying model of educational opportunities as potential expe- 
riences should look at appendix B. 

The visions behind science curricula have many aspects: conceptions of science, percep- 
tions of students, perceived national needs for educational outcomes, and so on. One central 
aspect of science curricular visions is determining which opportunities for science experiences 
should be provided to students at particular points in schooling — opportunities intended to pro- 
vide a core of common science experiences and outcomes. The focus of investigation is on 
aims; the data sources are mainly selected documents and the main aspect of national aims to 
be illuminated are the intended opportunities for common science experiences. 

Curriculum and the International Association for the Evaluation ofEducational 
Achievement (lEA) 

TIMSS is an lEA study, and these studies — since the late 1970s — have considered cur- 
riculum as a complex constmct with several facets, each linked to a context or level of educa- 
tional activity. Curriculum is considered as intention — seen in national policies and official 
documents reflecting societal visions, educational planning, and official or political sanctioning 
for educational objectives. At the level of teacher and classroom activity, curriculum is consid- 
ered as creative implementation of those intentions and objectives. At the level of student out- 
comes, the curriculum is considered as attainment — the result of what takes place in class- 
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rooms. Academic achievement and student belief measures doeument part of these student 
attainments. 

A eommonplaee assumption of edueational researehers has long been that how students per- 
form on tests is elosely related to what they experienee in elassrooms. These opportunities for 
experienee — the instruetional events and aetivities in whieh students have partieipated and that 
help prepare them to solve test items — have been eoneeptualized as “opportunity to learn” 
(OTL) in past lEA and other studies. The OTL eoneept has been measured typieally by having 
teaehers examine tests to be administered to their students. Teaehers then report whether the 
students have been taught the skills neeessary to eomplete the tested tasks satisfaetorily. The 
index for OTL often has been simply the pereentage of teaehers in a eountry reporting that stu- 
dents have been given adequate opportunity to answer speeifie test items. Several variations of 
the questions prompting sueh teaeher ratings have been used in past studies. 

Previous lEA studies have suggested that this eoneeption of edueational opportunity as OTL 

— a measure based on teaeher ratings of individual aehievement test items — has serious faults. 
While a variant of traditional OTL is used in TIMSS, from the first, the intention has been to 
use a more sophistieated eoneeption of edueational opportunity (see appendix B) when inves- 
tigating seienee eurrieula — both as intention and as implementation. The eurrieulum analysis 

— for whieh this volume is an initial report — is part of that attempt to use a more informative 
eoneept of edueational opportunity to help better eharaeterize eurrieular visions and intentions. 
In this, it goes beyond traditional lEA OTL approaehes. 

Defining Curricular Intentions: Curriculum Guides and Textbooks 

Curriculum guides (or whatever they are called in participating countries) articulate official 
policies as they apply to large groups of students — to all students in a certain grade, in a spe- 
cific type of school, etc. In short, curriculum guides set out curricular intentions. Each is an 
official, comparatively global guiding statement for what a science curriculum is intended to be 
in a specific context and, perhaps, how related instruction is to be conducted. Textbook authors 
write at least in part to support implementation of national intentions. They reflect — with dif- 
fering clarity — science curricula as set out in curriculum guides (present and past) but as inter- 
preted by one set of individuals, the textbook authors. 

Textbooks have official status in some countries, and the clarity with which they reflect offi- 
cial curriculum is carefully controlled. In other countries, textbooks are developed more inde- 
pendently — and may reflect more independent interpretations of curricula as set out in (one or 
more, current or past) curriculum guides. Their status as “official” documents corresponding- 
ly varies, from official curriculum documents supplementing curriculum guides to completely 
unofficial materials for implementing instruction that reflect independent, and even private, cur- 
ricular interpretations. 
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Textbooks are not widely available in some eountries or are available mainly for teaehers to 
help earry out elassroom aetivities. In many other eountries, textbooks are the single, standard 
instruetional resouree most teaehers and most students share. Currieulum guides almost always 
offieially define eurrieulum for large groups of students. In many eountries, however, students 
are not even aware of these doeuments. Often eurrieulum guides are not eonsulted daily even 
by teaehers. By eontrast, evidenee suggested that textbooks were present in almost every elass- 
room in the TIMSS eountries and were used regularly in instruetion. Thus, while textbooks 
were often not officially national in eharaeter, they were a common element in most classrooms 
in most TIMSS countries. 

The official status of curriculum guides was comparatively clear, yet curriculum guides var- 
ied in design, function, and detail as much as the government policies they articulated. In fact, 
guides varied so greatly both between and within countries that what was considered a curricu- 
lum guide in one country might be unrecognizable as such in another. See chapter 4 for a fur- 
ther discussion of curriculum guides. 

In contrast, the official status of textbooks varied greatly among the TIMSS countries, yet 
textbooks were instantly recognized as commonplace in classrooms in every country despite 
variation in design and use. Textbooks provided a more detailed map of scientific disciplines, 
topics, and performances to be mastered in pursuing national goals: they were the “potentially 
implementable” curriculum. Each was a detailed chart proposing a particular path among the 
aspects of a science curriculum. Certainly textbooks did not force teachers and students to fol- 
low the same path in every classroom in which they were used. They did attempt, however, to 
provide one strategy for navigating among science topics and skills and to support a range of 
varied implementations within a broad reflection of curricular intention. Figure A. 1 suggests 
that textbooks serve as intermediaries in implementing science curricular intentions. 

The ways in which curriculum guides and textbooks were used officially to state curricu- 
lum — and textbooks less officially to guide implementation — are varied, and thus using these 
documents to investigate curricular intentions was difficult. Methodologically, curriculum 
guides were considered as providing the primary — and purest — official, public statement of 
curriculum and curricular intentions. Textbooks were considered as providing — for most 
countries — a supplemental, supporting reflection of those intentions. For most countries, text- 
books were viewed as a primary bridge between intention and implementation — between the 
ministry and the classroom. While care must be taken in interpreting textbook data — given 
different national status for and uses of textbooks — research conducted in many countries 
indicates the enormous influence of textbooks on student achievement.^ Neither curriculum 
guides or textbooks could stand alone as the sole source for the TIMSS curriculum analyses. 
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Figure A. 1 

Textbooks — The Potentially Implementable Curriculum. 

Textbooks served as intermediaries in turning intentions into implementations. They helped 
make possible one or more potential implementations of science curricular intentions. 







CUR RICULUM, EXPERIENCE AND OPPORTU NITY 1 8 5 

Notes 

‘ Jackson, P. W. 1992. “Conceptions of Curriculum and Curriculum Specialists. ” In P.W. 
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Appendix B 

A Model of Potential Educational Experiences 

Inferring curricular intentions and aims by analyzing curriculum materials requires assump- 
tions about how intentions affect classroom organization and activities. Such assumptions are 
the basis for any document analysis methodology. These assumptions and relationships are best 
portrayed in a model. That is, one needs a thorough model of potential educational experience 
since that is the key aspect in which curriculum is viewed here. 

Curriculum designers make crucial decisions on how students should spend classroom time 
— choices based on national aims for science education. The set of aims pursued must be lim- 
ited since each student’s time is limited — that is, emphasizing one science topic must often be 
at the expense of time for another. 

These aims and choices affect what happens in classrooms. The system by which they do 
so is intricate. Other factors, including textbook markets, teacher training and credentialing, 
school and classroom inspections, examinations and university admission policies, also affect 
classroom activities. “Official” curricular intentions and aims — as set out in curriculum guides 
and reflected (at least in part) in textbooks — can help shape classroom activities but not com- 
pletely determine them. A model of potential experiences must include not only official inten- 
tions, but also the goals of other planners and organizers, how intentions are carried out, how 
intentions and actions interact to produce learning, and other factors. TIMSS used a Model of 
Potential Educational Experiences that captures some of the important aspects of how educa- 
tional opportunities are shaped and how they are related to official intentions and aims. 

The model (see figure B.l) is built on four broad research questions (the columns) and four 
educational system levels (the rows). Within the cells created by combinations of these ques- 
tions and system levels are major constmcts that describe educational opportunity — and sci- 
ence learning opportunities in particular. This model and its research questions are described 
more fully in a related technical report,’ a part of the TIMSS effort to characterize educational 
opportunity. 

This model involves many constructs, and investigating each typically requires multiple 
sources of evidence. This volume focuses on part of the model — the characterization of 
intended student attainments. Even this limited part of the model involves a variety of relevant 
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Figure B.l 

The TIMSS Model of Potential Educational Experiences. 

The means by which curricular aims and choices affect what happens in classrooms, 
and what students attain is part of an intricate system that includes many factors. 
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information: ministerial policy documents, formal curriculum guidelines, course syllabi, text- 
books, syllabi for national examinations, teacher pedagogical plans as they interpret broader 
requirements, tests, and so on. To focus on central documents common to virtually all partici- 
pating countries, attention here was limited to science curriculum guides and student textbooks. 
Supplemental materials and annotated “teacher editions” of textbooks offer additional informa- 
tion but were less consistently used and thus not included in this initial study. While guided by 
the model above, the present investigations are limited (1) by focusing on curricular intentions 
and (2) by using only curriculum guidelines and textbooks as data sources. 
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I Survey of Mathematics and Science Opportunities, TIMSS Curriculum Analysis: A Content 
Analytic Approach, (East Lansing, MI: SMSO, 1993). 
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Appendix C 

Timss Curriculum Frameworks: 

Measuring Curricular Elements 

The Third International Mathematies and Seienee Study (TIMSS) was designed to involve 
extensive data eolleetions from partieipating national eenters, an analysis of eurrieulum doeu- 
ments, a range of questionnaires, and eomplex attainment testing. This multi-eomponent data 
eolleetion (earried out in partieipating eountries and at several international sites) made it essen- 
tial that all TIMSS eomponents be linked by a eommon eategory framework and deseriptive 
language. Whether elassifying a test item, eharaeterizing part of a eurrieulum doeument, or 
linking a questionnaire item to other TIMSS parts, all deseriptions had to use eommon terms, 
eategories, and standardized proeedures to assign numerieal eodes for entry into the appropri- 
ate database. 

This eommon language was provided by two framework doeuments: one for the seienees 
and one for mathematies. Eaeh eovered the full range of the years of sehooling in a unified eat- 
egory system. Eaeh framework was artieulated first only in teehnieal reports (as is still true for 
more extensive explanatory notes) but has now been reprodueed and doeumented in a mono- 
graph.* 

Eaeh framework doeument was multi-faeeted and multi-layered. It eonsidered three aspeets 
of subjeet matter eontent and performanee: content (subjeet matter topie), performance expec- 
tation (what students were expeeted to do with partieular eontent), and perspective (any over- 
arehing orientation to the subjeet matter and its plaee among the diseiplines and in the every- 
day world). Content as subjeet matter topie is relatively elear; performanee expeetation is less 
so. It was deeided not to attempt identifying student (eognitive) performanee proeesses, whieh 
would be highly inferential, partieularly subjeet to eultural differenees, and thus not feasible in 
a eross-eultural eontext. It was deeided rather to speeify expeetations for student (seienee) per- 
formanees — for example, formulating or elarifying a problem to be solved, developing a solu- 
tion strategy, verifying a problem solution, and so on, without positing eognitive means for pro- 
dueing the performanees. This foeused on more generie, less eulture-bound task expeetations 
and demands. Postulating speeifie eognitive proeesses neeessarily would have involved eul- 
turally tied eognitive eategories inherent in student thinking in any given eountry. 
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In addition to being a multi-aspect system, each framework was designed for using multi- 
ple categories. Each element (science curriculum guide, textbook segment, test item) could be 
considered as part of more than one category of any framework aspect. Each element was to 
be classified in as many framework categories as needed to capture its richness. Each would 
have a unique, often complex “signature” — a set of content, performance expectation, and 
perspective categories that characterized it, at least in terms of the framework’s three aspects. 
This system is flexible. It allows for simple or more complex signatures as needed. 

Such flexible multi-dimensionality was essential for analyzing curriculum documents. How 
often segments involved multiple contents or performance expectations had to be determined 
empirically by the documents, not by the study design. Characterizing science curricula 
required a tool permitting coherent categorization of curriculum guides’ and textbooks’ major 
pedagogical features. It had to be capable of translating many nationally idiosyncratic ways for 
specifying science education goals into a common specification language. The TIMSS science 
curriculum framework was designed to be such a tool. 

Framework development was cross-national. The frameworks had to be suitable for all par- 
ticipating countries and educational systems. Representing the interests of many countries, the 
frameworks were designed cross-nationally and passed through several iterations. The result is 
imperfect, but it is still a step forward in cross-national comparisons of curricular documents. 
Its value may be judged by the results of this and related volumes. 

Each framework aspect is organized hierarchically using nested sub-categories of increas- 
ing specificity. Within a given level, the arrangement of topics does not reflect a particular 
rational ordering of the content. See figure C. 1 for an overview of the content aspect of the sci- 
ence framework. The end of this appendix briefly presents all three aspects of the science 
framework. Each framework was meant to be encyclopedic — intended to cover all possibili- 
ties at some level of specificity. No claim is made that the “grain size” — the level of speci- 
ficity for each aspect’s categories — is the same throughout the framework. Some sub-cate- 
gories are more inclusive and commonly used, others less so. Specificity had broad common- 
alties but also considerable variation among the participating countries. This varying granular- 
ity requires special care in designing framework-based methods and interpreting the results of 
their use. 

In the science framework, content involves eight major categories, each with two to six sub- 
categories.2 Some sub-categories are divided further. The level of detail and organization 
reflects compromise between simplicity (fewer categories) and specificity (more categories). 
The hierarchical levels of increasing specificity allow some flexibility in detail level and gen- 
eralization. 

Performance expectation is a flexible category system (see below for details), but — as with 
the other framework aspects — no category or sub-category is considered exclusive. Any doc- 
ument segment should involve at least one or more performance expectation categories from 
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Figure C.l 

Content Categories of the Science Framework. 

Each aspect of the framework contained a set of main categories. Each main category contained one or more 
levels of more specific sub-categories. The main content categories are shown here with some sub-categories 
expanded to give a better insight into the framework’s structure. 



1 . 1 . 1 . 1 Composition 

1 . 1 . 1 .2 Landforms 

1.1. 1.3 Bodies of Water 

1 . 1 . 1 .4 Atmosphere 

1.1. 1.5 Rocks, Soil 

1 . 1 . 1 .6 Ice Forms 
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the framework. Complex, integrated performanees ean thus be eharaeterized in detail — as ean 
eontents and perspeetives. This differs from traditional grid elassifieations that generate unique 
eategorizations eombining one element from two or more dimensions. 

Complex signatures reveal important differenees in how eurrieula are meant to aehieve their 
goals. They show differenees in how subjeet matter elements are eombined and differenees in 
what students are expeeted to do. Eaeh framework ean reveal subjeet matter presented in an 
integrated, thematie way, with a rieh set of performanee expeetations for students as reeom- 
mended by eurrieulum reformers in many eountries. However, it also allows simpler “signa- 
tures” — for example, those often assoeiated with more traditional eurrieula and many tradi- 
tional aehievement test items. 

The following is a brief listing of the eontent, performanee expeetation, and perspeetive 
eodes of the seienee framework. For a more detailed diseussion, see the monograph refereneed 
or the teehnieal report of “Explanatory Notes” for the seienee framework. 
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1.1 Earth Sciences 

1.1.1 Earth Features 

1 . 1 . 1 . 1 Composition 
1. 1.1.2 Landforms 

1.1. 1.3 Bodies of Water 

1.1. 1.4 Atmosphere 

1.1. 1.5 Roeks, Soil 

1.1. 1.6 lee Forms 

1.1.2 Earth Processes 

1.1. 2.1 Weather and Climate 

1.1. 2. 2 Physieal Cyeles 

1.1. 2. 3 Building and Breaking 

1.1. 2. 4 Earth’s History 

1.1.3 Earth in the Universe 

1.1. 3.1 Earth in the Solar System 

1.1. 3. 2 Planets in the Solar System 

1.1. 3. 3 Beyond the Solar System 

1.1. 3. 4 Evolution of the Universe 

1.2 Life Sciences 

1.2.1 Diversity, Organization, Structure of Living Things 

1.2. 1.1 Plants, Fungi 

1.2. 1.2 Animals 

1.2. 1.3 Other Organisms 

1.2. 1.4 Organs, Tissues 

1.2. 1.5 Cells 

1.2.2 Life Processes and Systems Enahling Life Functions 

1.2.2. 1 Energy Handling 
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1.2.2. 2 Sensing and Responding 

1.2.2. 3 Bioehemieal Proeesses in Cells 

1.2.3 Life Spirals, Genetic Continuity, Diversity 

1.2.3. 1 Life Cyeles 

1.2. 3. 2 Reproduetion 

1.2. 3. 3 Variation and Inheritanee 

1.2. 3. 4 Evolution, Speeiation, Diversity 

1.2. 3. 5 Bioehemistry of Geneties 

1.2.4 Interactions of Living Things 

1.2. 4.1 Biomes and Ecosystems 

1 .2.4.2 Habitats and Niehes 

1 .2.4.3 Interdependence ofEife 
1.2.4. 4 Animal Behavior 

1.2.5 Human Biology and Health 

1.2.5. 1 Nutrition 

1.2. 5. 2 Disease 
1.3 Physical Sciences 

1.3.1 Matter 

1 . 3 . 1 . 1 Classification of Matter 

1.3. 1.2 Physical Properties 

1.3. 1.3 Chemical Properties 

1.3.2 Structure of Matter 

1 .3.2.1 Atoms, Ions, Molecules 

1.3.2. 2 Macromolecules, Crystals 

1.3.2. 3 Subatomic Particles 

1.3.3 Energy and Physical Processes 

1 .3.3.1 Energy Types, Sources, Conversions 
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1.3. 3. 2 Heat and Temperature 

1.3. 3. 3 Wave Phenomena 

1.3. 3. 4 Sound and Vibration 

1. 3.3.5 Light 

1.3. 3. 6 Eleetrieity 

1.3. 3. 7 Magnetism 

1.3.4 Physical Transformations 

1.3.4. 1 Physieal Changes 

1.3. 4. 2 Explanations of Physieal Changes 

1.3. 4. 3 Kinetie Theory 

1.3. 4. 4 Quantum Theory and Fundamental Partieles 

1.3.5 Chemical Transformations 

1.3.5. 1 Chemical Changes 

1.3. 5. 2 Explanations of Chemical Changes 

1.3. 5. 3 Rate of Change and Equilibria 

1.3. 5. 4 Energy and Chemical Change 

1.3. 5. 5 Organic and Biochemical Changes 

1.3. 5. 6 Nuclear Chemistry 

1.3. 5. 7 Electrochemistry 

1.3.6 Forces and Motion 

1.3.6. 1 Types of Forces 

1.3. 6. 2 Time, Space, and Motion 

1.3. 6. 3 Dynamics of Motion 

1.3. 6. 4 Relativity Theory 

1.3. 6. 5 Fluid Behaviour 
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1.4 Science, Technology, and Mathematics 

1.4.1 Nature or Conceptions of Technology 

1.4.2 Interactions of Science, Mathematics, and Technology 

1.4.2. 1 Influence of Mathematics, Technology in Science 

1.4.2. 2 Applications of Science in Mathematics, Technology 

1.4.3 Interactions of Science, Technology, and Society 

1.4.3. 1 Influence of Science, Technology on Society 

1.4.3. 2 Influence of Society on Science, Technology 

1.5 History of Science and Technology 

1.6 Environmental and Resource Issues Related to Science 

1.6.1 Pollution 

1.6.2 Conservation of Land, Water, and Sea Resources 

1.6.3 Conservation of Material and Energy Resources 

1.6.4 World Population 

1.6.5 Food Production, Storage 

1.6.6 Effects of Natural Disasters 

1.7 Nature of Science 

1.7.1 Nature of Scientific Knowledge 

1.7.2 The Scientific Enterprise 

1.8 Science and Other Disciplines 

1.8.1 Science and Mathematics 

1.8.2 Science and other Disciplines 
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Performance Expectations 

2.1 Understanding 

2.1.1 Simple Information 

2.1.2 Complex Information 

2.1.3 Thematic Information 

2.2 Theorizing, Analyzing, and Solving Problems 

2.2.1 Abstracting and Deducing Scientific Principles 

2.2.2 Applying Scientific Principles to Solve Quantitative Problems 

2.2.3 Applying Scientific Principles to Develop Explanations 

2.2.4 Constructing, Interpreting, and Applying Models 

2.2.5 Making Decisions 

2.3 Using Tools, Routine Procedures, and Science Processes 

2.3.1 Using Apparatus, Equipment, and Computers 

2.3.2 Conducting Routine Experimental Operations 

2.3.3 Gathering Data 

2.3.4 Organizing and Representing Data 

2.3.5 Interpreting Data 

2.4 Investigating the Natural World 

2.4.1 Identifying Questions to Investigate 

2.4.2 Designing Investigations 

2.4.3 Conducting Investigations 

2.4.4 Interpreting Investigational Data 

2.4.5 Formulating Conclusions from Investigational Data 
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2.5 Communicating 

2.5.1 Accessing and Processing Information 

2.5.2 Sharing Information 

Perspectives 

3.1 Attitudes Towards Science, Mathematics, and Technology 

3.1.1 Positive Attitudes Toward Science, Mathematics, and Technology 

3.1.2 Skeptical Attitudes Towards use of Science and Technology 

3.2 Careers in Science, Mathematics and Technology 

3.2.1 Promoting Careers in Science, Mathematics, and Technology 

3.2.2 Promoting Importance of Science, Mathematics, and Technology in 
Non-technical Careers 

3.3 Participation in Science and Mathematics by Underrepresented Groups 

3.4 Science, Mathematics, and Technology to Increase Interest 

3.5 Safety in Science Performance 



3.6 Scientific Habits of Mind 
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Notes 

> Robitaille, D. F. et al., Curriculum Frameworks for Mathematics and Science, (Vancouver: 
Pacific Educational Press, 1993). 

2 This volume follows a convention in referring to the eategories in the seienee framework as 
eompared to less formal listing of seienee topies. Categories from the framework will be 
listed enelosed in single quotation marks — for example, ‘bioehemistry of geneties.’ 
Informal topie areas and referenees to topies that are part but not all of a formal eategory 
will not have quotation marks — for example, gene expression rather than ‘gene expres- 
sion.’ A similar eonvention will be followed for diseussing eategories from the other aspeets 
of the framework. 
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Appendix D 

Topic Tracing Methods 

A technique called “topic trace mapping” provided a broad multi-grade map of content cover- 
age. Curriculum experts, using their knowledge of curriculum guides from each country, were 
asked to report — for each, most detailed science framework content category and for the full set 
of grade levels within their country — in which grade or grades work on each topic was intended 
to be introduced, the range of grades during which instruction was intended to take place, and any 
grades for which the topic was to be a focus (to receive special curricular emphasis). 

Figure D. 1 shows “tracings” or “maps” of the intended curricular coverage for two science 
topics in a sample of selected countries to show some of the diversity typical of these data. 
Grade level referred to the sequence of years in school and was adjusted to the student ages and 
educational policies of the countries involved. That is, the same grade might not represent the 
same modal student age in two different countries depending on the educational systems 
involved (although little variation was observed). The symbol “-” indicates that experts report- 
ed aspects of the topic were typically part of science instruction at that grade level. The sym- 
bol “+” indicates that experts reported that aspects of that topic received special curricular atten- 
tion and emphasis of some sort at that grade level. 

‘Biomes and ecosystems’ refers to all treatments of these biological topics. The figure shows, 
for example, that content from ‘biomes and ecosystems’ received only 2 years of coverage (grades 
7 and 8) in Hungary, with focused instruction in grade 7. By contrast, Mexican experts indicated 
that 8 years of study were intended for this content starting in grade 2 — with special emphasis 
in grade 7 and then again in grades 11 and 12 (and in both these grades the topic received con- 
siderable curricular focus). Other patterns emerged, ranging from countries planning instruction 
in this topic only in upper secondary (for example, 1 year each in French-speaking Belgium and 
Tunisia, 4 years in the People’s Republic of China in this list of selected countries) to those that 
intended coverage of the topic from almost the beginning of primary to the end of upper secondary 
school (Portugal, France, and the Dominican Republic). Other countries show patterns of inter- 
rupted or multi-sited coverage, (for example, Latvia, Greece, and Japan). 

‘Energy types, sources, and conversions’ provides a contrast. This topic includes the treat- 
ment of potential and kinetic energy, work, efficiency, as well as sources of energy, and so on 
— in short, all energy-related content in the physical sciences. Experts indicated that it was 
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Figure D.l 

Two Representative Topic Trace Maps. 

These data are typical topic trace maps for a sample of countries selected to show representative diversity among 
maps produced by topic trace mapping. The results are typical of those for other topics and countries. 
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taught primarily in secondary school in many countries — as might be expected for topics in 
physics. However, some countries report coverage of this topic almost throughout the years of 
schooling (i.e., Israel, Norway), whereas still others report some work on these topics in ele- 
mentary school, with successive treatment in upper secondary (France and Tunisia). 

The information provided by this method is based on soliciting stmctured expert opinion in 
each country and only indirectly on official curriculum guides. Clearly, however, the method 
provides an essential first step in understanding the context of intended content coverage for 
those grades targeted for achievement testing by TIMSS. These grades are, essentially, the two 
grades containing the modal number of 9-year-old students, the two for 13-year-old students, 
and physics specialists in the terminal year of secondary school. As an instance of the value of 
these data, curriculum guides in the People’s Republic of China and the Russian Federation 
likely would specify differently the objectives for teaching ‘biomes and ecosystems’ in grade 8. 
This reflects that the topic was being introduced in the former in grade 8, while students in the 
latter were likely to have studied it for several years before grade 8. Similarly, the absence of 
‘energy types, sources, conversions’ for grade 4 in Japan and Latvia — compared, for example, 
to France and Mexico, where experts indicated instruction would have begun earlier — likely 
implies a difference in how the topic was treated (if at all) in grade 4 textbooks in those coun- 
tries. 

Data gathered by this topic tracing method allows an initial assessment of the variety and 
flow of content coverage goals across the grades in participating countries. This method has 
important drawbacks, although it provides essential information. First, it relies on expert opin- 
ion. Second, this method proved in pilot work and field trials to yield no useful information on 
performance expectations and perspectives. Fortunately, topic tracing is only one component 
of a set of multiple methods that focus mainly on detailed document analysis of curriculum 
guides and textbooks. 
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Appendix E 

Document Analysis Methods 



Document Sampling 

Curriculum document sampling was essential for doeument-based methods. To eolleet 
detailed information for the Third International Mathematies and Seienee Study (TIMSS) tar- 
geted grades — those for student aehievement testing — eountries gathered data from samples 
of eurrieulum guides and textbooks for those grades. 

Eaeh national doeument sample eomprised, as appropriate for that eountry, the following 
text materials: 

• The national seienee eurrieulum guide or guides (if any) eovering eaeh grade; 

• Regional, provineial, state, or eantonal seienee eurrieulum guides eovering eaeh grade 
(if needed); 

• Offieial national seienee textbooks (if any); and 

• The most widely used eommereial textbooks if “offieially” provided books were not used. 

Eaeh national sample was required to eontain eurrieulum guides and textbooks suffieient to 
represent materials for no less than one-half of the students in the targeted grades. These doe- 
ument samples were also to eover major regional, sehool type, ete., strata in eaeh eountry. 

The resulting sample for the 48 eountries (those reporting at least some doeument-based 
eurrieulum data) ineluded 77 seienee eurrieulum guides for the upper grade of Population 1, 111 
for the upper grade of Population 2, and 62 for the physies speeialists in Population 3, for a total 
of 250 eurrieulum guides. There were 75 seienee textbooks for the upper grade of Population 
1, 155 for the upper grade of Population 2, and 60 for the physies speeialists in Population 3, 
for a total of 290 sampled seienee textbooks. These are the data sourees for doeument analy- 
ses reported in this volume. 

Document Analysis 

The doeument sample was large, and with 48 eountries the doeuments’ linguistie variety, 
was daunting. Methods had to be developed that did not require translating large doeument seg- 
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merits, although each sampled document (as marked in the analysis) was collected and 
archived. Central to all document analysis methods was operationally specifying how all doc- 
ument analyses, marking procedures, and reporting procedures would be handled. Training 
native-language speakers in each country to carry out the procedures to produce coded data 
forms with some English text was also essential. These data, both coded and full-text English, 
were entered into a central data bank, cleaned, edited, audited, and verified by the countries 
contributing the data. 

This plan was implemented and is described below. Similar procedures were used to code 
critical features of both curriculum guides and textbooks. Those features were only some of the 
possibilities considered for analysis; the selected features were considered salient and the most 
feasible for this first attempt at large-scale, within-language, cross-national document analysis. 

Unit Identification 

Most documents were both structurally intricate and long — at least for preparing a statis- 
tical abstract with minimal English-language documentation. The first step in each document 
analysis process was to sub-divide each document into smaller “units of analysis” so that more 
detailed analyses could be accomplished. For curriculum guides, these units were the smallest 
functional segments of each document — identified by clear separation rules to segment each 
document into a set of such units, each classified as one of a small number of types capturing 
a major function in curriculum guide presentations. Curriculum guides unit types were intro- 
ductions, units stating policies, units stating educational objectives, units specifying science 
contents, units dealing with issues in science pedagogy, and “other” units. 

Table E.l shows — for the entire document set, both curriculum guides and textbooks — 
the proportions of different unit types. More than 50 percent of the science curriculum guide 
units for the upper grade of Populations 1 and 2, as well as the physics specialists of Population 
3, were devoted to specifying objectives and content. Science curriculum guides for the upper 
grades of both Populations 1 and 2 had an average of 17 to 19 other units. Further, policy units 
were not very common on average — representing 5 percent or less of the units. 

Textbooks were similarly partitioned. The most fundamental unit type was a lesson. A “les- 
son” was a text material segment devoted to a single main science topic and intended to corre- 
spond to a teacher’s classroom lesson on that topic taught over one to three instructional peri- 
ods. Some textbook materials (for example, reviews) covered content from several lessons and 
were classified as “multiple-lesson pages.” These two unit types, along with introductions, 
instructional appendices, and “other” made up the five textbook unit types. 

Each country’s data collection team identified and assigned unit types to each textbook unit. 
Table E. 1 shows about 78 percent of the units identified were lessons in the pool of science text- 
books sampled. Typically there were less units in textbooks intended for the upper grade of 
Population 1 (an average of 30) than for the upper grade of Population 2 or for physics spe- 
cialists in Population 3 (averaging 45 and 68 respectively). 
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Table E.l 

Unit Types in Cnrriculnm Gnides and Textbooks. 

Percentages of each unit type for the documents sampled are shown for all populations and for both guides and 
textbooks. Curriculum guides were dominated by objective and content units. Lesson units clearly dominated 
textbooks. 
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Block Identification 

Dividing documents into broad functional units simplified analysis; but this procedure was 
not enough to capture essential stmctural aspects allowing construction of a “statistical” 
description of the textbook or at least some of its key features. To eapture more features show- 
ing differenees among seienee eurrieulum guides and seienee textbooks, these texts were divided 
into smaller segments ealled ‘bloeks.’ 

Figure E.l is a reproduetion of two sample pages from a Colombian seienee textbook for 
the upper grade of Population 2. These two pages are the first of Unit 35, a lesson (unit type 2 
— “T. 2” here). This unit is on geneties and the dairy industry, part of the treatment of genetie 
strueture and systems in eighth grade seienee. Following the standardized partitioning rules, 
these two pages are segmented into seven bloeks — eaeh with marked boundaries and num- 
bered 1 through 7. 

In a similar way eaeh unit of every sampled seienee textbook was sub-divided into smaller 
segments — i.e., ‘bloeks.’ Identifying several different bloek types for textbooks and others for 
eurrieulum guides helped eonstruet a more detailed “statistieal abstraef’ of eaeh doeument. For 
eurrieulum guides, the types ineluded individual polieies, single objeetives, single seienee eon- 
tent elements, individual pedagogieal suggestions, individual examples related to pedagogieal 
suggestions, individual testing or “assessmenf’ suggestions, and “other” bloek types. 

For seienee textbooks, bloek types ineluded narrative bloeks (eentral, related, and unrelat- 
ed sidebar instmetional narrative), graphie bloeks related to narrative, graphie bloeks unrelated 
to instmetional narrative, exereise and question sets (both direetly related to a unit’s eontent and 
“unrelated,” for example, review sets inserted as part of a unit on a different topie), suggested 
aetivities, worked examples, and “other” textbook bloek types. Preeise mles available in 
TIMSS teehnieal reports governed partitioning units into bloeks and identifying bloek types. 

As an example of the proeess, eonsider figure E. 1 again. Even bloeks are marked and num- 
bered on the two pages — note that Bloek 3 is related to Bloek 1 . Bloek 1 is a brief segment 
of narrative. This passage explains how the dairy industry uses mieroorganisms to produee a 
variety of produets and that their speeifie genetie eharaeteristies produee produets of varying 
aromas, flavors, and eonsisteneies. The speeifie eharaeteristies of various speeies of miero- 
organisms and their most common use is presented in the related table (Bloek 3). This is fol- 
lowed by an aetivity, to be earried out in elass using Lactobacillus bulgaricus to produee yogurt. 
This aetivity ineludes produeing the yogurt and then testing its viseosity, appearanee, ete. — and 
reeording the results of the tests in a table to be devised by the student. In Bloek 4, students are 
asked to deseribe the relationships among a series of seientifie eoneepts, sueh as “gene, ehro- 
mosome, DNA” and “ribosomes, messenger RNA, transeriber RNA, DNA.” The following 
Bloek (5) is a small exereise asking students to define, in their own words, various terms sueh 
as “loeus,” “alleles,” and “gametogenesis.” The last bloeks on page 99 deseribe a fietional legal 
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Figure E.l 

Two Sample Textbook Pages. 

Here are two sample pages from a Columbian science textbook for the upper grade of Population 2. They 
represent part of one unit. Their division into blocks and the numbers for each block and unit were indicated by 
the Colombian National Document Analysis Team. 
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case in which the paternity of a child is in question. Students are asked to research what types 
of scientific tests are available to “solve the conflicf ’ and to describe their use. 

The strategy in the opening pages of this unit is clear. A general narrative introduces the 
topic of applications of genetics. An activity is presented. A review exercise and a dictionary 
exercise follow. Finally, another application of genetic science is discussed and children are 
asked to do research on the application. All of this detail must be reduced to a few essential 
elements that allow the search for commonalities among countries and populations. One ele- 
ment of those details is block type, recording here that the strategy on these two pages was nar- 
rative, activities, and exercises. 

Table E.2 shows that most blocks in curriculum guides were related to content elements, 
objectives, and pedagogical suggestions. However, there were fewer pedagogical suggestion 
blocks in science than was the case in mathematics curriculum guides. Comparatively few 
blocks contained official policies or assessment suggestions. In textbooks, roughly 33 percent 
of all blocks — in all of the grades from which textbooks came — were graphic blocks. 
Narrative (written explanation and discussion) — averaged about one-quarter of the blocks. 
Activity blocks diminished for each successive population, going from about 15 percent for the 
upper grade of Population 1, to scarcely 3 percent in Population 3 physics texts. However, 
overall, science textbooks still had more activity blocks than did mathematics textbooks, where 
there were more worked examples. Perhaps the most striking contrasts between science and 
mathematics textbooks was in the relative occurrence of exercises and graphics. Almost one- 
half the blocks in mathematics textbooks were devoted to exercises, while only about 15 per- 
cent of the blocks in science texts were. Thirty percent of science textbook blocks were graph- 
ics, whereas only about 10 percent was the norm in mathematics. 

Coding 

Central to preparing “abstracts” of documents was partitioning and assigning types (units 
and blocks). These data and their relation to document pages had to be recorded. It was also 
essential to identify the contents, performance expectations, and perspectives relevant to each 
block. After dividing a document into units and blocks, each block within each unit was 
described by assigning to it codes for categories from each aspect of the science framework. 
These codes — along with block and unit types — were the main information recorded for the 
“statistical abstracf’ characterizing each document. Some other descriptive information was 
also provided as described in appendix A. 

Figure E.2 shows how members of a national data collection team record these categories 
on paper forms with columns corresponding to blocks within each unit. This reproduction of 
the coding sheet used by national coders to record block numbers, links to document pages, 
block numbers, block types, and science framework codes was completed by a reviewer of the 
Colombian text segment reproduced in figure E. 1. The first seven columns are for the seven 
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Table E.2 

Distribution of Block Types. 

Here are the percentages of block types for the pool of sampled curriculum guides and textbooks. Curriculum 
guides were mainly composed of objective, content, and pedagogical suggestion blocks. Textbooks mainly con- 
tained related graphic and narrative blocks. Activities played a larger role for younger populations; exercise sets 
played a larger role for older populations. 



Curriculum Guides official 

Policies 


Objectives 


Content 

Element 


Pedagogical 

Snggestions 


Examples 


Assessment 

Suggestions 


Other 


Missing 


Population 1 6 

Upper Grade 


24 


36 


16 


11 


3 


3 


1 


Population 2 7 

Upper Grade 


26 


39 


14 


9 


3 


2 


1 


Popnlation 3 6 

Specialists 


26 


40 


11 


12 


3 


2 


1 



Textbooks 


Narrative 


Related 

Narrative 


Unrelated 

Instructional 

Narrative 


Related 

Graphic 


Unrelated 

Graphic 


Exercise/ 
Question Set 


Popnlation 1 
Upper Grade 


27 


4 


1 


35 


2 


15 


Popnlation 2 
Upper Grade 


30 


8 


1 


31 


2 


17 


Popnlation 3 
Specialists 


28 


9 


2 


34 


1 


17 





Unrelated 
Question/ 
Exereise Set 


Activity 


Worked 

Example 


Other 


Missing 


Popnlation 1 
Upper Grade 


1 


16 


0 


1 


0 


Popnlation 2 
Upper Grade 


1 


8 


1 


1 


1 


Popnlation 3 
Specialists 


0 


3 


6 


1 


0 






214 



MANY VISIONS, MANY AIMS 



Figure E.2 

Sample Block Coding Form. 

This is the completed coding form that includes the blocks from the earlier sample text pages (Figure E. 1). It records a 
block’s page number (in the text), identification number, type, and codes for appropriate framework categories. 



D»rwt1 Anal Nm DA-3 



































DOCUMENT ANALYSIS METHODS 



215 



blocks in the text segment. Notiee the bloek types are reeorded by numerieal eode (1, 8,4, and 
6) — and linked both to textbook page and bloek number. The first portion of text on page 98 
has been assigned a bloek type of 1, whieh indieates narrative. It has also been assigned three 
eontent eodes: 1.2. 1.3 refers to types of mieroorganisms; 1.2.2. 3 is the seienee eategory frame- 
work for ‘bioehemieal proeesses in eells’; and the eode 1.4. 2. 2 indieates industrial applieations. 
The performanee expeetation eode assigned is 2.1.1, whieh indieates that this portion of the text 
merely requires students to understand ‘simple information.’ Bloek 3 is the table assoeiated 
with Bloek 1, whieh is indieated by the notation “3/1” in the “bloek ID number” eell. The bloek 
type is 4, indieating a related graphie; it is also assigned the eontent eodes of 1.2. 1.3 and 1.4.2. 2. 

Bloek 2 is assigned a type of 8, indieating an aetivity. The eontent eodes assigned are iden- 
tieal to those for Bloek 1; however, the performanee expeetation eodes are quite different. 2.3.2 
indieates ‘eondueting routine experimental operations,’ and 2.3.4 refers to ‘organizing and rep- 
resenting data’ (part of the aetivity is to devise a table to reeord data). Bloeks 4 and 5 are the 
two exereises (type 6), one assigned a performanee expeetation eode of 2.1.1, the other a new 
eode, 2.5.1 for ‘aeeessing and proeessing information,’ indieating that students are expeeted to 
use a referenee work (dietionary). Finally, Bloeks 6 and 7, an aetivity (type 8) and its related 
graphie (type 4) refer to the material on determining paternity in the eontext of a legal dispute. 
Here, in addition to the eontent eodes used in previous bloeks, the eoder has assigned 1.4.3. 1, 
the framework eategory for ‘influenee of seienee, teehnology, on soeiety.’ Bloek 6 is also 
assigned a perspeetive eode of 3.4, the framework eode indieating ‘seienee, mathematies, and 
teehnology to inerease interest,’ signifies that popular or intriguing information is used to 
inerease student interest in the topie of geneties. The rare use of perspeetive eodes was a typi- 
eal pattern. Notiee also that all bloeks have eomplex “signatures” - all bloeks on the form 
reeeived more than one eode for a single aspeet from the framework. 

The eomplexity of bloek signatures — the number of eategories from eaeh aspeet of the 
framework assigned to a bloek — is important. Complieated signatures reveal eomplexity and 
suggest higher levels of integration in eurrieulum guides and textbooks. Table E.3 shows the 
pereentage of bloeks that reeeived single and multiple eontent eodes in seienee eurrieulum 
guides and textbooks at eaeh of the three TIMSS populations. For eontent, for all three target 
grades, around 43 pereent of the eurrieulum guide bloeks were assigned one eode and 20 per- 
eent assigned two. In textbooks, material is more eomplex, with a quarter of the bloeks reeeiv- 
ing at least two eontent eodes. Overall, seienee shows an inerease in eomplex signatures for 
higher grades in eurrieulum guides — and this is somewhat true for textbooks as well. 

Table E.4 summarizes how seienee eurrieulum guides and textbooks differed in the number 
of performanee expeetation eodes assigned. About 25 pereent of the bloeks in seienee eurrieu- 
lum guides had no performanee expeetations indieated. This proportion was far lower for text- 
books. About one-half of the bloeks in seienee eurrieulum guides had one performanee expee- 
tation eode assigned, as did about 85 pereent of textbooks. The number of bloeks assigned 
more than one performanee expeetation was mueh greater in eurrieulum guides (about 30 
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Table E.3 

Proportion of Single and Multiple Content Codes. 

The average number of content codes assigned to a block is given for each type of document and population. 
The percentages of single and multiple codes among all those assigned to blocks are also given. Clearly, single 
and double codes predominated. 



Curriculllin Guides Average Number Distribution of Number of Content Codes 

of Content 

Codes/Block 0 1 2 3 4 Sormore 



Population 1 


1.14 


30 


40 


20 


7 


2 


1 


Population 2 
Upper Grade 


1.28 


23 


43 


22 


9 


2 


1 


Population 3 
Specialists 


1.25 


22 


45 


23 


7 


2 


1 


Textbooks 
















Population 1 
Upper Grade 


1.38 


4 


63 


25 


7 


1 


0 


Population 2 
Upper Grade 


1.45 


3 


62 


25 


8 


2 


0 


Population 3 
Specialists 


1.49 


1 


64 


25 


8 


2 


0 
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Table E.4 

Proportion of Single and Multiple Performance Expectation Codes. 

The average number of performance expectation codes assigned to a block is given for each type of document 
and population. The percentages of single and multiple codes are also given. 



Curriculum Guides 


Average Number 
of Content 


Distribution of Number of Content Codes 






Codes/Block 


0 


1 


2 


3 


4 


5 or more 


Population 1 
Upper Grade 


1.10 


28 


44 


20 


7 


1 


1 


Population 2 
Upper Grade 


1.12 


25 


49 


20 


5 


1 


1 


Population 3 
Specialists 


1.22 


22 


45 


23 


8 


1 


1 


Textbooks 
















Population 1 
Upper Grade 


1.06 


8 


81 


8 


2 


0 


0 


Population 2 
Upper Grade 


1.06 


5 


87 


6 


2 


0 


0 


Population 3 
Specialists 


1.05 


3 


91 


5 


1 


0 


0 
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percent of blocks) than textbooks (merely 8 percent). This would appear to indicate that text- 
books are more conservative in performance expectations for students than are curriculum 
guides. Thus, while simpler signatures predominated in both, there was a significant minority 
of blocks in curriculum guides with more complex performance demands. The case for per- 
spective codes differed, with 83 percent or more of blocks in science curriculum guides 
assigned no perspective codes and more than 90 percent of the blocks in textbooks assigned 
none. 

Training, Reliability and Quality Assurance 

Data collection methods were demanding, as can be seen even from this brief sketch. More 
details can be found in TIMSS technical reports. This demanding data collection required addition- 
al procedures to ensure high data quality, reliability, and validity. The approaches used were face- 
to-face training, an initial assessment of reliable blocking and coding (with retraining if necessary), 
careful monitoring and country review of all data submitted, and assessment of coding reliability. 

Representatives responsible for science and mathematics curriculum data collection in 
every TIMSS country attended regional training on the procedures outlined above. Training 
used a standard 3 -day design with training of trainers, complete manuals documenting all 
aspects of the standardized training and all procedures, and initial consultations on each coun- 
try’s documents. These training sessions used standardized presentations, training-to-criterion 
exercises, and more than 400 printed pages of training materials to ensure a thorough, relative- 
ly uniform initial understanding of the data collection techniques. Representatives of 50 coun- 
tries attended these sessions, including all those eventually taking part in the curriculum analy- 
sis. Each “trainee” was requested to conduct similar training sessions in his or her own coun- 
try for all personnel used to collect and document data. 

An initial quality assurance phase was used to verify the adequacy of procedure use imme- 
diately after training. Those responsible for each country’s curriculum data were asked to sub- 
mit data samples collected from each coder to the international center coordinating curriculum 
data collection before proceeding with the rest of data collection. These samples were evaluat- 
ed by comparing independent analyses of translated versions by international referees. National 
curriculum analysis coordinators were provided with detailed comments on each coder’s work. 
Based on this evaluation, countries were requested either to proceed with data collection or to 
train their personnel and/or to provide additional work samples. Only when each country coder 
had demonstrated criterion concordance with international referees were countries asked to 
continue with the collection of final data. 

Final data were examined as they arrived at the international center coordinating the cur- 
riculum analysis. All questions of accuracy and conformity with procedures were identified and 
clarified in communication with the data collection teams in each country. Cleaned and clari- 
fied data were entered into a central database and subjected to further error checks and assess- 
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ment of data entry accuracy. Cleaned data were subjected to a reliability analysis. Since there 
were no complete translations of all documents, a traditional inter-rater reliability estimate was 
clearly inappropriate. A more complex procedure was developed (and is being described in a 
technical report currently in preparation). Essentially, a random sample of units from the data- 
base was translated (if not in English), recoded by referees, and compared to the country cod- 
ings of the same material. These comparisons showed concordance indices over 80 percent in 
virtually all cases and often 90 percent or more. 
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Appendix F 

Participating Countries 



Argentina 


ARG 


Japan 


JPN 


Australia 


AUS 


Korea 


KOR 


Austria 


OST 


Eatvia 


EVA 


Belgium (Flemish-speaking) 


BFL 


Eithuania 


ETU 


Belgium (Freneh-speaking) 


BFR 


Mexieo 


MEX 


Bulgaria 


BGR 


Netherlands 


NED 


Canada 


CND 


New Zealand 


NZE 


China, People’s Republie of 


CHN 


Norway 


NOR 


Colombia 


COL 


Philippines 


PHE 


Cyprus 


CYP 


Portugal 


PRT 


Czeeh Republie 


CZE 


Romania 


ROM 


Denmark 


DNK 


Russian Federation 


RUS 


Dominiean Republie 


DRP 


Seotland 


SCO 


Franee 


FRA 


Singapore 


SGP 


Germany 


DEU 


Slovak Republie 


SVK 


Greeee 


GRC 


Slovenia 


SVN 


Hong Kong 


HKG 


South Afriea 


SAE 


Hungary 


HNG 


Spain 


ESP 


leeland 


ISE 


Sweden 


SWE 


Iran 


IRN 


Switzerland 


SUI 


Ireland 


IRE 


Thail and 


THA 


Israel 


ISR 


Tunisia 


TUN 


Italy 


ITA 


United States of Ameriea 


USA 
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ARGENTINA 
Prof. Carlos Mansilla 
Universidad del Chaco 

AUSTRALIA 
Dr. Jan Lokan 
Australian Council for 
Educational Research (ACER) 

AUSTRIA 

Dr. Gunter Haider 

Universitat Salzburg 

Institut fiir Erziehundswissenschaft 

BELGIUM (Flemish-speaking) 

Dr. Christiane Brusselmans-Dehairs 

Rijksuniversiteit Ghent 

Seminarie en Laboratorium voor Didactiek 

(French-speaking) 

Prof Georges Henry 
SEDEP, Universite de Liege 

BULGARIA 

Dr. Kiril G. Bankov 

Foundation for Research, 

Communication, Education and Informatics 
(INCOBRA) 

CANADA 
Dr. Alan Taylor 

University of British Columbia 

Mr. Jim Brackenberry 
Ministry of Education, Alberta 

Allan Craig 

Ministry of Education and Training, Ontario 



CHINA 

Prof Meng Hong Wei 

The China National Institute of 

Educational Research 

COLOMBIA 

Dr. Carlos Jairo Diaz 

Universidad del Valle 

CYPRUS 

Dr. Constantinos Papanastasiou 
University of Cyprus 

CZECH REPUBLIC 
Mr. Vladislav Tomasek 
Research Institute of Education 

Dr. Jana Strakova 

Research Institute of Education 

DENMARK 
Dr. Borge Prien 

The Danish National Institute for 
Educational Research 

DOMINICAN REPUBLIC 

Prof Sarah Gonzalez 

Pontificia Universidad Catolica Madre 

Maestra 

Dr. Eduardo Luna 
Barry University 

FRANCE 
Dr. Emilie Barrier 
Centre International d’Etudes 
Pedagogiques (CIEP) 

Dr. Anne Servant 

Ministere de TEducation Nationale 
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GERMANY 

Dr. Rainer H. Lehmann 

Universitat Hamburg 

GREECE 

Dr. Georgia Kontongiannopoulo-Polydorides 
University of Athens 

HONG KONG 
Dr. Frederiek Leung 
University of Hong Kong 

HUNGARY 
Dr. Peter Vari 

National Institute of Publie Edueation 
ICELAND 

Dr. Einar Gudmundson 
Ministry of Edueation and Culture 

IRAN 

Dr. Ali Reza Kiamanesh 
Ministry of Edueation 

IRELAND 
Ms. Deirdre Stuart 
St. Patriek’s College 
Edueational Researeh Centre 

ISRAEL 

Dr. Pinehas Tamir 
The Hebrew University 

ITALY 

Dr. Anna Maria Caputo 
Ministerio della Pubbliea Instruzione 

JAPAN 

Dr. Masao Miyake 
Mr. Yuri Saruta 

National Institute for Edueational Researeh 



KOREA 
Dr. JinGyu Kim 

National Board of Edueational Evaluation 
LATVIA 

Dr. Andrejs Geske 
University of Latvia 

LITHUANIA 

Dr. Algirdas Zabulionis 

University of Vilnius 

MEXICO 

Dr. Fernando Cordova Calderon 
Seeretaria de Edueaeion Publiea 
Evaluaeion de Politieas y Sistemas Edueativos 

NETHERLANDS 
Dr. Wilmad Kuiper 
University of Twente 

NEW ZEALAND 
Dr. Hans Wagemaker 
Ministry of Edueation 

NORWAY 
Dr. Svein Lie 
University of Oslo 

PHILIPPINES 
Dr. Milagros D Ibe 
University of the Philippines 

Dr. Ester B. Ogena 

Seienee Edueation Institute, Department of 
Seienee and Teehnology 

PORTUGAL 

Dr. Gertrudes Amaro 

Institute de Inova^ao Edueaeional 
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ROMANIA 

Ms. GabrielaNoveanu 

Institute of Educational Sciences 

RUSSIAN FEDERATION 

Dr. Galina S. Kovalyova 

The Russian Academy of Education 

SCOTEAND 
Mr. Brian Semple 

Scottish Office Education Department 

SINGAPORE 
Ms. Mok Siew Eng 
Ministry of Education 

SEOVAK REPUBIC 
Dr. Maria Berova 
Vyskummy listav pedagogicky 

SEOVENIA 

Mr. Marjan Setinc 

Pedagoski Institut, Ejubljana 

SOUTH AFRICA 
Dr. Derek Gray 

Human Sciences Research Council 
SPAIN 

Mr. Jose Antonio 
Eopez Varona 

Instituto de Calidad y Evaluacion (INCH) 

SWEDEN 

Dr. Kjell Gisselberg 

University of Umea 
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SWITZERLAND 

Mr. Erich Ramseier 

Amt fiir Bildungsforschung der 

Erziehungsdirektion des Kantons Bern 

THAILAND 

Dr. Suwaporn Semheng 

Institute for the Promotion of Teaching 

Science and Teehnology (IPST) 

TUNISIA 

Dr. Mahdi Abdeljaouad 
Institut Superieur de I'Edueation 
de la Formation Continue 

USA 

Dr. William H. Sehmidt 
Miehigan State University 
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Appendix G 

Documents Analyzed 

Country/Document Type Document Title/Publisher/Date 

Argentina 

Textbook Biologia 1. Kapelusz, 1985 

Fisica 2. Kapelusz, 1992 

Serie Dinamica-Ciencias Naturales. Kapelusz, 1987 

Australia 

Currieulum Guide Physics Study Design. Vietoria Currieulum and Assessment 

Board, 1991 

Science and Technology. K-6. Board of Studies, New South 
Wales, 1991 

The Science Framework P-10. Ministry of Edueation (Sehools 
Commission), Vietoria. 

Science Syllabus (1984). Seeondary Sehool Board, New South 
Wales, Amended May 1989 

Two Unit Course- Physics. Board of Senior Sehool Studies, New 
South Wales, Department of Edueation 

Textbook Exploring Science 2. Maemillan Company of Australia, 1986 

Exploring Together Book 2. Martin Edueational Horwitz 
Grahame Pty Etd., 1988 

Fundamentals of Senior Physics. Heinemann, 1985 

Look! Book 2. Australian Seienee and Teehnology, Eongman 
Cheshire, 1991 

Physics Two: Sound, Electronics, Electric Power Motion, 

Gravity, Structures, Light and Matter. Rigby Heinemann 
(Oetopus Publishing Group Australia Pty Etd), 199 1 

Secondary Science 2. John Wilkinson, MaeMillan Co. of 
Australia Pty Etd., 1983 
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Austria 

Curriculum Guide Lehrplan der AHS-Vollstandige Ausgabe 3. Osterreichischer 

Bundesverlag, 1989 

Lehrplan der Hauptschule. Osterreichischer Bundesverlag, 1989 
Lehrplan der Volksschule. Osterreichischer Bundesverlag 

Textbook Biology und Umweltkunde - 8. Veritas, 1991 

Physik und Chemie 3 (Part A and B). Ueberreuter, 1987 
Physik und Chemie 4 (Part A and B). Ueberreuter, 1990 
Sachunterricht 4. Osterreichischer Bundesverlag, 1992 
Sachunterricht 4 - Salzburg. Osterreichischer Bundesverlag, 
1992 

Belgium (FI) 

Curriculum Guide Leerplan aardrijkskunde voor de eerste graad, tweede gemeen- 

schappelijk jarr - D/1990/4244/1. Gemeenschapsonderwijs. 
Leerplan aardrijkskunde voor de eerste graad, tweede leerjaar. 

Nationaal Verbond van het Katholiek Onderwijs, 1990 
Leerplan aardrijkskunde voor het basisonderwijs. Nationaal 
Verbond van het Katholiek Onderwijs, 1970 
Leerplan aardrijkskunde voor het rijkslager onderwijs. 

Ministerie van Nationale Opvoeding en Cultuur, 1970 
Leerplan biologie, tweede leerjaar van het secundair onderwijs. 

Nationaal Verbond van het Katholiek Onderwijs, 1988 
Leerplan biologie voor de eerste graad, tweede leerjaar - 
D/1989/4244/22. Gemeenschapsonderwijs 
Leerplan biologie, wetenschappelijk werk voor de eerste graad, 
tweede leerjaar D/1989/4244/22. Gemeenschapsonderwijs 
Leerplan fysica, moderne wetenschappen, wetenschappelijk werk 

- D/1989/0279/050. Nationaal Verbond van het Katholiek 
Onderwijs. 

Leerplan fysica, voor de derde graad ASO - D/1992/0279/014. 

Nationaal Verbond van het Katholiek Onderwijs. 

Leerplan fysica, voor de derde graad, 6de leerjaar doorstroming 

- D/1980/1984/39. Gemeensehapsonderwijs s 

Leerplan fysica, voor de eerste graad, tweede leerjaar - 
D/1980/1984/39. Ministerie van Nationale Opvoeding en 
Nederlandse Cultuur. 

Leerplan fysica, wetenschappelijk werk, eerste graad, tweede 
leerjaar - D/1980/1984/39. Ministerie van Nationale 

Opvoeding en Nederlandse Cultuur. 

Natuurwetenschappen voor het basisonderwijs. Nationaal 
Verbond van het Katholiek Onderwijs, 1980 




DOCUMENTS ANALYZED 



229 



Belgium (Fr) 

Curriculum Guide 



Bulgaria 

Textbook 



Canada 

Currieulum Guide 



Construire son milieu. Commentaire du programmes des etudes. 

Conseil eentral de I'Enseignement Primaire Catholique 
Enseignement secondaire de type I. Programmes experimentaux 
pour les trois degres. Sciences. MCAP, s.e., 1979 
Enseignement secondaire renove. 3e degre - 6e annee, de I'en- 
seignement general: programme de physique. Ministere de 
I’Edueation Nationale et de la Culture Franqaise, 1975 
Etude du milieu: (a) naturel et humain; (b) scientifique et tech- 
nologique. Ministere de I’Edueation Nationale et de la Culture 
Frangaise, 1982 

Plan d’ etudes et instructions pedagogiques pour les trois degres 
des ecoles primaires. Ministere de Tlnstruetion Publique, 1985 

Astronomy 3. Prosveta, 199 1 
Biology 2. Prosveta, 1986 
Chemistry 2. Prosveta, 1991 
Geometry 2. Prosveta, 1991 
Physics 2. Prosveta, 1991 
Science L Prosveta, 1991 

The Common Curriculum. Ontario Ministry ofEdueation, 1993 
Curriculum Guidelines Science Intermediate and Senior 
Divisions, Part 14. Ontario Ministry ofEdueation, 1988 
Elementary Science Curriculum Guide. Ministry of Edueation 
(BC), Program & Currieulum Development Braneh, 198 1 
The Formative Years. Ontario Ministry ofEdueation, 1975 
Junior Secondary Science Curriculum Guide and Resource Book. 
Ministry of Edueation (BC) 

Junior High Science Program of Studies. Alberta Edueation, 
1990 

Physics 10-20-30 Curriculum Guide. Alberta Edueation, 1977 
Programme d’ etudes primaire - Sciences de la nature. Direetion 
generale des programmes, Ministere de Tedueation du Quebee, 
1980 

Programme d’ etudes secondaire - Sciences physiques. Direetion 
generale des programmes, Ministere de Tedueation du Quebee, 
1987 

Science Intermediate and Senior Divisions, Part 2. Ontario 
Ministry of Edueation, 1987 

Science is Happening Here. Ontario Ministry ofEdueation, 1988 
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Textbook A la decouverte des sciences de la nature. LIDEC Inc., 1989 

Focus on Science 4. D.C. Heath Canada Ltd., 1983 
Focus on Science 8. D.C. Heath Canada Ltd., 1989 
Fundamentals of Physics: A Senior Course. D.C. Heath Canada 
Ltd., 1986 

Initiation a I ’etude scientifique de I ’environnement. Guerin, 
1988 

Physics (2nd Edition). Prentice Hall Inc., 1985 
Physics- Principles and Problems. Charles E. Merrill Publishing 
Co., 1986 

Probe 8. John Wiley & Sons, 1985 

Science. Addison - Wesley, 1980 

Science Directions 8. John Wiley & Sons, 1991 

China, People’s Republic of 

Textbook The First and Second Volumes of Geography for Junior 

Secondary Schools. People’s Education Press, 1992 
The First and Second Volumes of Physics for Junior Secondary 
Schools. People’s Education Press, 1991 
The First Volume of Science For Primary School. People’s 
Education Press, 1989 

Zoology for Junior Secondary School. People’s Education 
Press, 1988 

Colombia 

Curriculum Guide Ciencias Naturales y Salud. Ministerio de Educacibn Nacional, 

1987 

Ciencias Naturales y Salud. Ministerio de Educacion Nacional, 
1990 

Programa General de Fisica. Ministerio de Educacibn Nacional, 
1990 

Ciencias Naturales 4. Editorial Santillana, 1989 
Ciencias Naturales y Salud 8. Editorial Sanistllana, 1991 
Descubrir 8. Editorial Norma, 1992 
Fisica, 11° ■ Educar Editores, 1991 
Fisica Fundamental 2. Editorial Norma, 1993 
Viva la Ciencia 4. Editorial Norma, 1992 

Anthropology and Health Education for the Second Grade of 
Gymnasium. Ministry of Education, 1992 
Biology Lessons. Ministry of Education, 1991 
Chemistry for the Eight Grade. Ministry of Education, 1991 



Textbook 



Cyprus 

Textbook 
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Czech Republic 

Curriculum 



Textbook 



Denmark 

Curriculum 



Physics for Lyceum, 12th Grade, Combination 2. Ministry of 
Education, 1992 

Science for the Fourth Grade of Primary School. Ministry of 
Education, 1987 

Science, Fifth Grade. Ministry of Education, 1992 
Science for 6th Grade. Ministry of Education, 1992 
Steps in Physics. Ministry of Education, 1992 
Steps in Physics, 8th Grade. Ministry of Education, 1992 
Steps in Physics for 9th Grade. Ministry of Education, 1992 

Guide Curriculum Guide for Basic School: Elementary Geography 

Graded. Fortuna, 1991 

Curriculum Guide of Basic School: Science, Grade 4. Fortuna, 
1991 

Curriculum Guide of Basic School: Physics, Grades 6 to 8. 

Fortuna, 1991 

Curriculum Guide of Basic School: Life Science and Geology, 
Grades 5-8. Fortuna, 1991 

Curriculum Guide of Basic School: Geography, Grades 5-8. 

Fortuna, 1991 

Curriculum Guide for Gymnasium: Physics. Fortuna, 1991 
Curriculum Guide for Basic School: Chemistry, Grades 7 to 8. 
Roenik, 1991 

Chemistry for Grade 8 of Basic School. Statni Pedagogicke 
Nakladatelstvi, 1991 

Elementary Geography and FBstory for Grade 4 of Basic School. 
Fortuna, 1992 

Life and Earth Science for Grade 8 of Basic School. Statni 
Pedagogicke Nakladatelstvi, 1988 
Physics for Grade 4 of Gymnasium. Statni Pedagogicke 

Nakladatelstvi, 1987 

Physics for Grade 8 of Basic School. Statni Pedagogicke 
Nakladatelstvi, 1985 

Science for Grade 4 of Basic School. Statni Pedagogicke 
Nakladatelstvi, 1987 

Guide Fysik/kemi 1989/2 37. 13 Undervisningsvejledning for 

Folkeskolen. Undervisningsministeriet 
Fysik, Bekendtgorelse og vejledende retningslinier. 
Undervisningsministeriet Direktoratet for Gymnasieskolerne 
ogHF, 1988 
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Textbook 



Dominican Republic 

Curriculum Guide 



Textbook 



France 

Curriculum Guide 



Textbook 



Germany 

Curriculum Guide 



Biologi 3. klassetrin. Grundbog. Gjellerups biologi system, 1982 
EL-7. DLH Fysisk Institut, Sjaelsoskolen Birkerod, 1980 
Fysikkens spor. Nordisk Forlag A.S., 1991 
Luft og vand, Ny Fysik/kemi 3. Gyldendal, 1991 

Ciencias - Educacion Bdsica - Cuarto Grado. Secretaria de 
Estado de Educacion, Bellas Artes y Cultos, 1987 
La Naturaleza y sus Manifestaciones - Educacion Bdsica - 
Octavo Grado. Secretaria de Estado de Educacion, Bellas 
Artes y Cultos, 1987 

Estudios Sociales y Ciencias Naturales, Libro 8vo. Grado. 

Secretaria de Estado de Educacion, Bellas Artes y Cultos, 1993 
Matematica y Ciencia 4°. Secretaria de Estado de Educacion, 
Bellas Artes y Cultos, 1993 

Colleges: Programmes et instructions. Ministere de 1 'Education 
Nationale, de la Jeunesse et des Sports, et CNDP, Hachette, 
1985 (Sciences et techniques biologi ques et geologiques: p. 
269-271 and 275-277.) 

Complements aux programmes de biologie et geologie. 

Supplement au Bulletin Officiel n°25, 1988. 

Les Cycles a I’ecole primaire. Ministere de FEducation 
Nationale, de la Jeunesse et des Sports, et CNDP, Hachette, 
1991 (Science et technologic: p 66-68 and p. 109-112.) 
Principes directeurs de I'enseignement de la physique et de la 
chimie au college et au lycee. Bulletin officiel du Ministere de 
FEducation Nationale n°31, 1992. 

Programmes de physiques et de chemie en classes de quatrieme 
et quatrieme technologique. Bulletin officiel du Ministere de 
FEducation Nationale n°31, 1992. 

Biology and Geology. Nathan, 1992 
Physical Science. Hachette, 1993 
Sciences and Technology, C.M. Bordas, 1986 

Richtlinien Biologie/Lernbereich Naturwissenshaften/Llaupts- 
chule. Der Kulturminister des Eandes Nordrhein - Westfalen, 
1989 

Richtlinien/Physik/Hauptschule. Der Kulturminister des Eandes 
Nordrhein - Westfalen, 1989 

Richtlinien und Lehrpldne/Physik/Gymnasium LL. Der 
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Textbook 



Greece 

Curriculum 



Textbook 



Hong Kong 

Curriculum 



Kulturminister des Landes Nordrhein - Westfalen, 1981 
Richtlinien und Lehrpldne/Biologie/Gymnasium/Sekundarstufe 
1. Der Kulturminister des Landes Nordrhein - Westfalen, 1993 
Richtlinien und Lehrpldne/Biologie/Gymnasium/Sekundarstufe 
1. Der Kulturminister des Landes Nordrhein - Westfalen, 1981 

Elemente Chemie Nordrhein - Westfalen 7. Ernest Klett Verlag, 
1988 

Mens ch und Raum: Geographie 7. Cornelsen Vergal, 1989 
Physics fur Gymnasien Al. Cornelsen Verlag 
Terra, Geographie 7/8. Ernest Klett Verlag, 1988 

Guide Curricula for Primary School Courses. O.E.0.B., 1987 

Curriculum Guide of Lower Secondary School- Science. 
National Printing Service, 1985 

Curriculum Guide of Upper Secondary School Science. National 
Printing Service, 1987 

Chemistry, 2"'' Gymnasium Class (8“' Grade). Organization for 
the Publication of Educational Books (O.E.0.B), 1991 
Geography. Organization for the Publication of Educational 
Books (O.E.0.B), 1992 

Pluman Biology 2"'' Gynmasium (8* Grade). Organization for the 
Publication of Educational Books (O.E.0.B), 1991 
Physics. Organization for the Publication of Educational Books 
(O.E.0.B), 1992 

Physics, 2"‘‘ Gymnasium Glass (8* Grade). Organization for the 
Publication of Educational Books (O.E.0.B), 1991 
We and the World. Organization for the Publication of 
Educational Books (O.E.0.B), 1992 

Guide Syllabus for Physics (Advanced Level). The Curriculum 
Development Council, The Education Department, Hong 

Kong, 1992. 

Syllabus for Science (Forms I-III). The Curriculum 
Development Council, The Education Department, Hong 

Kong, 1992. 

Syllabuses for Primary Schools: Plealth Education. Government 
Printer, 1980 

Syllabuses for Primary Schools: Primary Science. Government 
Printer, 1990 
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Textbook 



Hungary 

Curriculum 



Textbook 



Iceland 

Curriculum 



Textbook 



Advanced Physics for Hong Kong. Volumes I and 2. John 
Murray, 1992 

Further Physics. Volumes I and 2. Longman Group (Far East), 
1992 

Health Education. Modem Educational Research Society Etd 
Integrated Science Today Book 2. Jing Kung Educational Press, 
1990 

New Geography 2 (Second Edition). Manhattan Press Etd., 1990 
Patterns in Geography 2. Patterns, People and Places - 
Contrasting Environments. Jing Kung Educational Press, 1990 
Primary Science. The Art Publisher, 1988 

Guide Bioldgia 6 -8. os^taly. Orszagos Pedagogiai Intezet, 1978 

Fi^ika I - IV (A gimndziumi oktatds es neveles terre). Orszagos 
Pedagogiai Intezet, 1978 

Fit^ika 6-8. os^tdly. Orszagos Pedagogiai Intezet, 1979 
Kormye^etismeret F5. os^aly. Orszagos Pedagogiai Intezet, 
1978 

Bioldgia 8. Tankonyvkiado, 1985 
Fi^ika 8. Tankonyvkiado, 1989 
Fi^ika IV. Tankonyvkiado, 1991 
Foldrajf 8. Tankonyvkiado, 1992 
Kemia 8. Tankonyvkiado, 1992 

Kornye^etismeret a^ dltaldnos iskoldk 4. os^tdlya sidmdra. 
Tankonjrvkiado, 1988 

Guide A'dalndmskrd Grunnskdla. MenntamaIara^uneyti^t mai, 1989 

Namskrd, Handa Framhaldsskdlum. Menntamalalara^uneyti^ 
skolamalaskrifstofa, jiini, 1990 

E?dis - og efnafrce^i Serkenni Efna. Namsgagnastofnun, 1983 
E’^isfrcerh - fyrir framhaldsskdla IB. IDNU, 1990 
E^lisfrce^i -fyrir framhaldsskdla 2. IDNU, 1991 
Llf a Nordurslddum - Inuitar. Namsgagnastofnun, 1985 
Llfl heitu landi - Tansania. Namsgagnastofnun, 1977 
Lifandi verur - Fjdlbreytni, flokkun, prdun. Namsgagnastofnun, 
1981 

Liffelog og vistkerfi. Namsgagnastofnun, 1982 
Lifi^ i kringum okkur. Namsgagnastofnun, 1981 
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Iran 

Textbook 

Ireland 

Curriculum 



Textbook 



Israel 

Curriculum 



v0 sjdvarsQuna Tslay^d. Namsgagnastofnun, 1982 
Vidfangsefni og adfer^ir. Namsgagnastofnun, 1981 

Experimental Sciences Grade 4. Ministry of Education, 1992 
Experimental Sciences Grade 8. Ministry of Education, 1992 
Physics. Ministry of Education, 1992 

Guide The Junior Certificate Science Syllabus. Department of 
Education, The Stationery Office, 1989. 

Primary School Curriculum, Teacher’s Elandbook, Part 2. 
Department of Education, 197 1 

Rules and Programme for Secondary Schools. Department of 
Education, The Stationery Office, 1989 - 1991 

Discover Our World - Environmental Studies, Book 3. Folens, 

1990 

Earth Science - additional unit to “Science for the Future". 
Folens, 1991 

Electronics - additional unit to “Science for the Future Folens, 

1991 

Energy Conversions - additional unit to “Science for the Future 
Folens, 1990 

Food Science - additional unit to “Science for the Future". 
Folens, 1990 

Elorticulture - additional unit to “Science for the Future”. 
Folens, 1991 

Materials Science - additional unit to “Science for the Future". 
Folens, 1990 

Science for the Future. Folens, 1990 

Science From the Beginning. Oliver and Boyd; 13“' impression, 
1988 

Senior Physics. Folens, 1987 

Guide Biology Curriculum Guide for Senior High Schools. The 
Ministry of Education and Culture, 1991 
Physics and Chemistry for Junior High Schools. The Ministry of 
Education and Culture, 1989 

Physics for Senior High School. The Ministry of Education and 
Culture, 1980 

Science in Technological Society. The Ministry of Education and 
Culture, 1988 
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Textbook From Elements to Compounds. Weizman Institute of Seienee, 

1978 

Issues on Reproduction. T.L. and Maaloth, 1991 
It Burns/ Burning Materials. Ramot Publishing House, Tel Aviv 
University 

Topics In Electromagnetism. Weizman Institute of Seienee, 1989 
Topics in Modem Physics. Weizman Institute of Seienee, 1989 
Waves and Physical Optics. Weizman Institute of Seienee, 1988 
With the Current. 1992 

Italy 

Textbook Introduction to Experimental Sciences. Le Monnier, April, 1980 

-April, 1991 

Laboratorio - Classe IV Giunti-Marzoeeo, 1990 
Laboratory for the New School. Giunti-Marzoeeo, 1992 
Linee Chiare 4. Editriee La Seuola, 1990 
Linee Chiare 5. Editriee La Seuola, 1990 

Japan 

Currieulum Guide The Course of Study for Elementary School Science. The 

Ministry of Edueation, 1989 

The Course of Study for Lower Secondary School Science. The 
Ministry of Edueation, 1989 

The Course of Study for Upper Secondary School Science. The 
Ministry of Edueation, 1989 

Textbook Physics. Tokyo Shoseki Company, Ltd., 1993 

Interesting Science, Grade 4, Volumes 1 and 2. Dai-Nippon 
Tosho Company, Ltd., 1993 

Middle School Natural Science, First Field, Volumes A and B. 

Dai-nippon Tosho Company, Ltd., 1993 
Middle School Natural Science, Second Field, Volumes. A and B. 

Dai-nippon Tosho Company, Ltd., 1993 
New Science, First Field, Volumes A and B. Tokyo Shoseki 
Company, Ltd., 1993 

New Science, Grade 4, Volumes 1 and 2. Tokyo Shoseki 
Company, Ltd., 1993 

New Science, Second Field, Volumes A and B. Tokyo Shoseki 
Company, Ltd., 1993 

Korea 

Currieulum Guide National Curriculum Guide for Elementary School. Ministry of 

Edueation, 1987 

National Curriculum Guide for High School. Ministry of 
Edueation, 1988 
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Textbook 



Latvia 

Curriculum Guide 



Latvia 

Textbook 

Lithuania 

Textbook 



Mexico 

Curriculum Guide 



National Curriculum Guide for Junior High School. Ministry of 
Education, 1987 

Chemistry. Kum Seung Publishing Co., 1989 
Laboratory and Observation Workbooks 4-1 and 4-2. Ministry of 
Education, 1992 

Nature Studies 4-1 and 4-2. Ministry of Education, 1992 
Science 2. Dong - A Publishing and Printing Co., 1990 
Physics. Dong-A Publishing & Printing Co., 1992 

Basic Education Standards in Biology. Ministry of Education, 
Culture and Science 

Basic Education Standards in Chemistry. Ministry of Education, 
Culture and Science 

Basic Education Standards in Geography. Ministry of 
Education, Culture and Science 

Fizikas Profdkuasa Vadlinijas. Ministry of Education, Culture 
and Science, 1995 

Physics Standards. Ministry of Education, Culture and Science, 
1992 

Sakumizglitibas vadlinijal un standard. Izglitibas Ministry a, 
1992 

Dabas maciba 4. Klasei. Zvaigue, 1989. 

Fizikas Pamati. Zvaigue, 1992 

Biology: Animals (Grades 7-8). Prosveschenie, 199 1 
Chemistry: Inorganic Chemistry (Grade 8). Prosveschenie, 1989 
Nature Study, Graded. Prosveschenie, 1991 
Physics 8. Prosveschenie, 1991 
Physics II. Prosveschenie, 199 1 

ABC de Quimica. Segundo Curso Secundaria. Ediciones 
Numancia, S.A., 1991 

Educacion Bdsica, Primaria, Plan y programas de estudio de 
Ciencias Naturales y Geografia. Secretaria de Educacion 
Publica, 1993 

Educacion Bdsica, Secundaria, Plan y programas de estudio de 
Ciencias. Secretaria de Educacion Publica, 1993. 

Programas maestros del tronco comun del Bachillerato 
Technoldgico, Fisica. Consejo del Sistema Nacional de 
Educacion Tecnologica, 1988 
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Textbook 



Netherlands 

Curriculum Guide 



Textbook 



New Zealand 

Curriculum Guide 



Textbook 



Textbook Resource 
Booklets for 
Teachers 



Ciencias Naturales Cuarto Grado. Secretaria de Educacion 
Publica, 1994 

Fisica 2. Publicaciones Culturales, 1994 

Fisica 3. Publicaciones Culturales, 1994 

Geografia Cuarto Grado. Secretaria de Educacion Publica, 1994 

Geografia de Mexico. Segundo Grado. Trillas, 1994 

La Magia de la Fisica. Ediciones Pedagogicas, 1994 

La Magia de la Quimica. Ediciones Pedagogicas, 1994 

Maravillas de la Biologia 2. Ediciones Pedagogicas, 1994 

Kerndoelen Basis onderwijs voor de natuur waaronder biologie. 

Info-Reeks Basisivorming, PMB, 1993 
Kerndoelen Basisonderwijs voor natuur /scheikunde, biologie en 
aardrijkskunde, Lnrichtingsbesluit vwo - havo - mavo - vbo. 
Info-Reeks Basisivorming, PMB, 1993 

Biologie voorjou, 2mhv. Malmberg, 1989 
Chemie, 3vwo / havo. Wolters - Noordhoff, 1989 
Geo Geordend 2hv. Meulenhoff Educatief, 1987 
Geoscoop, deel 2. Meulenhoff Educatief, 1990 
Natuurkunde in Contexten. Wolters - Noordhoff, 1989 
Natuurkunde voor nu en straks, Ihv. Thieme, 1983 
Natuurkunde voor nu en straks, 2lto. Thieme, 1979 
Natuurlijkl, deel 2. Malmberg, 1989 
Scheikunde mavo project, 3mavo Wolters-Noordhoff, 198 1 
Scoop - Natuurkunde 5/6vwo. Wolters - Noordhoff, 1991 

Science in the National Curriculum (Draft). Ministry of 
Education, 1992 

Science Syllabus and Guide: Primary to Standard 4. 

Department of Education, 1989 (revised) 

University Bursaries/Entrance Scholarships, Physics in School 
Awards: Prescriptions. NewZealandQualificationsAuthority, 1991 

3 Science Books 1 and 2. New House Publishers Etd., 1989 
Senior Physics for Form Seven. Heinemann Education, 1985 

Air: New Zealand Dept, of Education, 1982 
Cells and Circuits. New Zealand Dept, of Education, 1980 
Discovering Electricity. New Zealand Dept, of Education, 1980 
Eungi. New Zealand Dept, of Education, 1982 
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Norway 

Curriculum 



Textbook 



Philippines 

Curriculum 



Textbook 



Portugal 

Curriculum 



Textbook 



Magnets. New Zealand Dept, of Education, 1980 
Native Bush. Department of Education, 1980 
Sandy Shore. Department of Education, Wellington, 1980 
Solar System. New Zealand Dept, of Education, 1980 
Sound. New Zealand Dept, of Education, 1980 

Guide Curriculum Guidelines for Compulsory Education in Norway. 
The Ministry of Education and H. Aschehoug & Co., 1987 
Fysikk. Ministry of Education and Gyldendal, 1992 

Arbeidsbok til iVerden For AIM. Universitetsforlaget, 1988 
Forsok og Fakta. NKS - forlaget, 1989 
Heimkunnskap. Det Norske Samlaget, 1989 
Rom, Stoff Tid. 3 FY Cappelen, 1991 
Rom, Stoff Tid. 3 FY (laboratory manual), Cappelen, 1991 
Verden ForAlle, Faktabok. Universitetsforlaget, 1987 
Verden ForAlle, Undrebok. Universitetsforlaget, 1987 

Guide Desired Learning Competencies. Bureau of Secondary 
Education, Department of Education Culture and Sports, 1991 

Science and Health for a Better Life. Department of Education 
Culture and Sports, 1985 

Science and Technology I. Department of Education Culture and 
Sports, 1989 

Guide Ensino Basico - Programa do 1° Ciclo. Direc^ao Geral do 
Ensino Basico e Secundario. Ministerio da Educagao, Editorial 
do M.E. - Algueirao, 1990 

Ensino Basico - Programa do 1° Ciclo. Direc^ao Geral do 
Ensino Basico, e Secundario. Programa de Fisica e Quimica , 
Editorial do M.E. - Algueirao, 1992 
Organizagdo Curricular e Programas (Volume 1) Ensino Basico, 
3.° Ciclo. Direcgao Geral do Ensino Basico, e Secundario. 
Ministerio da Educa^ao, Editorial do M.E. - Algueirao, 1990 

Fisica 8.°. Didactica Editora, Eisboa, 1994 
O Bambi 4, Estudo do Meio. Porto Editora, Porto, 1994 
Quimica 8.°. Didactica Editora, Eisboa, 1994 
Vida Humana - Ciencias Naturais 8. ° Ano. Porto Editora, Porto, 
1994 
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Romania 

Curriculum Guide 



Textbook 



Russian Federation 

Curriculum Guide 



Programa de biologie. Editura Didactica si Pedagogica, 199 1 

Programa de biologie pentru invatamantul primar. Editura 
Didactica si Pedagogica Bucuresti, 1991 

Programa de chimie- pentru invatamantul gimnazial. Edutura 
Didactica si Pedagogica , 1991 

Programa de fizica pentru gimnaziu. Editura Didactica si 
Pedagogica Bucuresti, 199 1 

Programa de fizica pentru liceu. Editura Didactica si Pedagogica 
Bucuresti, 1991 

Programa de geografie pentru clasele V- VIII/5-8. Editura 
Didactica si Pedagogica Bucuresti, 1993 

Anatomia Fisiologia si Igieno Omului. Editura Didactica si 
Pedagogica Bucuresti, 1991 

Biologia. Editura Didactica si Pedagogica Bucuresti, 1992 

Chimia. manual pentru clasa a VIII- a. Editura Didactica si 
Pedagogica Bucuresti, 1992 

Chimie. Manual pentru clasa a Xll-a, Editura Didactica si 
Pedagogica Bucuresti, 1992 

Cunoasterea Mediului Inconjurator. Manual pentru clasa a IV- 
a. Editura Didactica si Pedagogica, R.A., 1992 

Fizica. Manual pentru clasa a VIII- a. Editura Didactic; si 
Pedagogica Bucuresti, 1992 

Fizica. Manual pentru clasa a Xll-a. Editura Didactica si 
Pedagogica Bucuresti, 1992 

Geografia Romaniei. Manual pentru clasa a VIII-a/8. Editura 
Didactica si Pedagogica Bucuresti, 1992 

Geografie. Manual pentru clasa a Xll-a. Editura Didactica si 
Pedagogica Bucuresti, 1992 

Curricula of General Secondary School Biology. Ministry of 
Education, 1990 

Curricula of General Secondary School Chemistry. Ministry of 
Education, 1990 

Curricula of Physics. Ministry of Education, 1990 

Curricula of Primary School (Grades F3) Nature Study. 
Ministry of Education, 1990 

Curricula of Secondary General School. Physics. Astronomy. 
Ministry of Education, 1990 
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Textbook 

Scotland 

Curriculum Guide 

Textbook 



Singapore 

Curriculum Guide 



Textbook 



Slovak Republic 

Curriculum Guide 



Biology: Animals (Grades 7-8). Prosveschenie, 199 1 
Chemistry: Inorgani chemistry (Graded). Prosveschenie, 1991 
Nature Study, Grade 3. Prosveschenie, 1991 
Physics 8. Prosveschenie, 199 1 
Physics 11. Prosveschenie, 1991 

Environmental Studies 5 - 14 (Draft). Scottish Office Education 
Dept., 1992 

Learning through Science: Colour. Macdonald Educational/ 
Simon and Schuster, 1982 

Learning through Science: Electricity. Macdonald Educational/ 
Simon and Schuster, 1982 

Learning through Science: Materials. Macdonald Educational/ 
Simon and Schuster, 1982 

Learning through Science: Moving Around. Macdonald 

Educational/Simon and Schuster, 1982 
Learning through Science: Out of Doors. Macdonald 

Educational/Simon and Schuster, 1982 
Learning through Science: Time, Growth and Change. 

Macdonald Educational/Simon and Schuster, 1982 
Starting Science. Oxford U Press, 1986 

GCE Advanced Level Syllabus (Physics). University of 
Cambridge, Eocals Exams Syndicate International Exams 
Science Syllabus (Lower Secondary ). Curriculum Planning 
Division, Ministry of Education, 1990 
Science Syllabus (Primary). Curriculum Planning Division, 
Ministry of Education, 1990 

Advanced Level Physics (6* Edition). Heinemann, 1987 
Lower Secondary Science Project Exploring Science 2. 

Curriculum Development Institute of Singapore (CDIS), 1984 
Primary Science Book 4. Curriculum Development Institute of 
Singapore (CDIS), 1982 

Ucebne osnovy 2. stupna zdkladnej skoly. Chemia (7. -8. rocnik). 

Slovenske Pedagogicke nakladatelstvo, 1987 
Ucebne osnovy 2. stupna zdkladnej skoly. Eyzika (6. -8 rocnik). 

Slovenske Pedagogicke nakladatelstvo, 1987 
Ucebne osnovy 2. stupna zdkladnej skoly. Prirodopis (5. -8. roc- 
nik). Slovenske Pedagogicke nakladatelstvo, 1987 
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Textbook 



Slovenia 

Curriculum Guide 



Textbook 



South Africa 

Curriculum Guide 



Textbook 



Ucebne osnovy pre gymnasia. Fyzika (I. -4. wcnik). Schvalilo 
Ministerstvo skolsta, mladeze a telesnej vychovy Slovenskej 
republiky dna, 1990 

Chemia pre 8. rocnik. Slovenske Pedagogicke Nakzadatelstvo, 

1992 

Fyzika pre 8. rocnik zdkladnej skoly A. Slovenske Pedagogicke 
Nakzadatelstvo, 1992 

Fyzika pre 8. rocnik zdkladnej skoly B. Slovenske Pedagogicke 
Nakzadatelstvo, 1992 

Prirodopis 4. Fyzika pre 4 rocnik Gymnazit. Slovenske 
Pedagogicke Nakzadatelstvo, 1991 
Prirodopis 8. Slovenske Pedagogicke Nakzadatelstvo, 1991 

Obvezni predmetnik in uc''ni na'Crt osnovne sole. Zavod 
Republikes za Slovenije Solstvo in sport, 1983 

Fizika. Drzavna zalozba Slovenije, 1991 

Fizika 8. Drzavna zalozba Slovenije, 1992 

Organska kemija. Drzavna zalozba Slovenije, 1993 

Razvojni nauk. Drzavna zalozba Slovenije, 1988 

Spoznavanje narave za 4. razred. Drzavna zalozba Slovenije, 

1993 

Core Syllabus For Geography Ordinary Grade Standards 5,6,7. 

Department of Education and Culture 
Final Core Syllabus for Physical Science (Higher Grade) 
Secondary School Standards 8, 9 and 10. Department of 
Education and Culture, 1982 

Syllabus for Environment Studies. Department of Education and 
Culture 

Syllabus for General Science, Standards 2, 3 & 4. Department of 
Education and Culture 

Syllabus for General Science, Standards 5, 6, 7. Department of 
Education and Culture 

Active General Science Standard 6. DeJager-HAUM Publishers, 
1984 

Employment: Jobs done by People. (Pre-publication edition). 
Enjoy Geography Standard 6. Eexicon Publishers and Hodder & 
Stoughton, 1992 
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Spain 

Curriculum Guide 



Textbook 



Sweden 

Curriculum Guide 



Textbook 



Switzerland 

Curriculum Guide 



Exciting Geography. Lexieon, 1985 

General Science in Action 6. Juta and Co, Ltd., 1984 

Our Environment. Environment Studies for Standard 2. 

(Manuscript for translations into African languages.) 

Physical Science in Action: Standard 10 (HG/SG). DeJager- 
HAUM, 1986 

Successful Science 10. Oxford University Press Southern Afriea, 
1989 

The World Around us 2. Juta and Co, Ltd., 1980 

Area de Ciencias de la Naturaleza. Vida Eseolar, 1978 
Programacion Eisica GOV B.O.E., 17-Marzo, 1978 
Programas renovados del Ciclo Medio. Vida Eseolar, 1982 

Espora, Ciencias Naturales. Anaya, 1990 
Espora, Ciencias Naturales. 8° Anaya, 1986 
Eisica Energia C.O.U. Edieiones SM, 1992 
Naturaleza 4 EGB Ciclo Medio. Santillana, 1992 
Nova 8, Naturaleza EGB. Santillana, 1992 

Ldropldn for Grundskolan (Lgr 80). Eiber Utbildningsforlag, 
Skolbverstyrelsen, 1990 

Ldropldn for Gymnasieskolan (Lgy 70) Supplement 32. 
Skolbverstyrelsen oeh Utbildningsfbrlaget 198 1 

Biologi for grundskolans hogstadium. Gleerups, 1994 
Fysik 90 Del I. Almgvist & Wiksells Fbrlag AB, 1989 
Fysik for Gymnasieskolan. Arskurs 3, Natur oeh Kultur, 1993 

Curriculum Guides for the Lower Secondary School. 

Dipartimento della pubbliea edueatione, 1987 
Curriculum Guides for the Primary School. Dipartimento della 
pubbliea edueatione, 1984 

Curriculum Guides for the Upper Secondary School. 

Dipartimento istmtione e eultura, 1992 
Lehrpldn fur die Primarschulen des Kantons Luzern. Ausgabe, 
1984 

Lehrpldn fur die Volksschule des Kanton Zurich. Erziehungs- 
direktion des Kanton Zurieh, 1991 
Lehrpldn Geographic, Primarschule/Sekundarschule, 5.-9. 
Schuljdhr. (Bern Government), 1983 




244 



MANY VISIONS, MANY AIMS 



Lehrpldn Heimatunterricht, Primarschule 1. -4. Schuljdhr (Bern 
Government), 1983 

Lehrpldn Naturkunde, Sekundarschule, 5.-9. Schuljdhr (Bern 
Government), 1983 

Naturlehre. Kommission Naturlehre lEOK, 1991 
Physik. Programm mit Kommentar. VSMP, 1976 
Plan d'etudes romand pour les classes de P‘ a 6“ annee. 

Secretariat a la coordination romande, 1989 
Plan d'etudes: Sciences experimentales, travaux pratiques de 

biologic. Ministere de I'education (Juras), 1993 

Textbook Bau und Funktionen unseres Korpers. Lehrmittelverlag des 

Kantons Zurich, 1989 

Geographic Europas. Lehrmittelverlag des Kantons Zurich, 
1991 

Invito alia fisical. Zanichelli Editore S.P.A., 1991 
Invito allafisica 3. Zanichelli Editore S.P.A., 1991 
Knowing the Environment. Third Primary. Department of Public 
Instruction of Vallis, 1985 
Pflanzenkunde. Verlag Paul Haupt Bern, 1985 
Physics. Experimental Science. Chemistry. L.E.P., 1992 
Physik. Schroedel Schulbuchverlag, 1989 
Tierkunde. Verlag Paul Haupt Bern, 198 1 
Welt der Physik und Chemie. Schroedel Schulbuchverlag, 1991 

Tunisia 

Textbook Sciences Naturelles. Deuxieme annee de I'enseignement sec- 

ondaire. Centre National Pedagogique, 1992 

United States 

Curriculum Guide Chapter 75 Curriculum- for Grades K-12. Texas Education 

Agency, 1992 

The Chemistry of Matter - Block H. The University of the State 
of New York. The State Department of Education, 1988 
Core Course Proficiencies: Science. New Jersey Department of 
Education, 1990 

Curriculum Frameworks for Grades 6-8 Basic Programs- 
Science and Health (Florida). Florida Department of 
Education 

Elementary Science Course of Study and Curriculum Guide. 

Idaho State Department of Education, 1989 
Elementary Science Curriculum Guide. New Jersey Department 
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Textbook 



of Education, 1985 

Elementary Science Syllabus. The University of the State of New 
York. The State Department of Education, 1992 
Energy: Sources and Issues - Block I. The University of the 
State of New York. The State Department of Education, 1991 
Energy and Motion - Block G. The University of the State of 
New York. The State Department of Education, 1990 
Essential Content. Hawaii Department of Education, 1992 
A Guide to Curriculum Planning in Science. Wisconsin 
Department of Public Instruction, 1990 
Guidelines for Science Curriculum in Washington Schools. 

Office of the Superintendent for Public Instruction, 1992 
Learner Outcomes - Science. Oklahoma State Department of 
Education 

Quality Core Curriculum Guides for K-12 Students in Georgia. 
Science. State of Nevada, Department of Education 
Science Comprehensive Curriculum Goals- a Model for Local 
Curriculum Development. Oregon State Department of 
Education, 1989 

Science Curriculum Guide- Section 3, Science. Idaho State 
Department of Education, 1989 

Science Eramework for Grades K-12. California State Board of 
Education, 1990 

State Goals and Sample Learning Objectives- Biological and 
Physical Sciences for grades K-12. Illinois State Department 
of Education 

Weather and Climate - Block E. The University of the State of 
New York. The State Department of Education, 1988 
Wyoming Standards of Excellence for Science Education. 
Wyoming Department of Education, 1989 

Earth Science. Merrill, 1993 

HBJ Science- for grade 4. Harcourt Brace Jovanovich, 1989 
Life Science. Merrill, 1993 

Modern Physics. Holt, Rinehart and Winston, 1992 
Physical Science- for grade 8. Merrill, 1993 
Science Horizons. Silver Burdett and Ginn, 1991 
Science in Your World. McMillan / McGraw Hill, 1991 
University Physics. Addison Wesley, 1992 
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Tables and Figures for all Participating Countries 




Figure 13.2 

Textbook Space Devoted to Major Science Topics. 

This figure shows the percentages of textbook blocks devoted to the eight broadest science framework content cate- 
gories for the textbooks of the upper grade of Population 2 in all countries. 
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Table 13.3 

Summary of Science Reform Interests in TIMSS Countries. 

Widespread interest was expressed in science education reforms. Here is a summary of reform interests in TIMSS countries as 
reported by experts within each country. 
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ship between study and daily life is gaining greater importance at all levels. In elementary schools, sci- 
ence is included in “life environmental studies,” which was just added to the curriculum. In lower sec- 
ondary, elective science courses were added and the use of computers was introduced. Students study 
about the computer as a tool of information science, the computer’s development, and development of 
computer chips. In upper secondary, there has been a tendency to make contents of science easier. 
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attention. The introduetion of 4 years of primary sehooling (instead of 3) in 1988 did eause struetural 
ehanges in the elementary seienee eurrieulum - two new eourses were added: “Surrounding World” for 
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solving. A very signiiicant reiorm is the development ot national standards tor science curricula, assess- 
ments, and teaching by the National Academy of Sciences. Technology exists increasingly in schools, but 
it tends to be supplemental or peripheral rather than integrated. For schools that do have technology, stu- 
dents are able to use telecommunications to exchange scientific data and to access scientific databases. 
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Figure 13.3 

Textbook Space Devoted to Major Performance Expectations. 

These data are similar to those in figure 3.2, but for the broadest performance expectation categories in 
textbooks for the upper grade of Population 2. They also reveal considerable variation. 
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Figurel3.3 (continued) 

Textbook Space Devoted to Major Performance Expectations. 
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Table 14.1 

Specificity of Curriculum Guides. 
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Figure 15.5 

Specific Country/Topic Durations Compared to What Was Typical. 

Statistical methods were used to produee numbers indieating how many fewer (gray-shaded ieons) or more (blaek-shaded icons) 
grades the duration for a speeifie eountry and topie was from the duration for a typieal eountry and topie — that is, a double differenee. 
Considerable diversity is shown. 
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Figure 15.5 (continued) 

Specific Country/Topic Durations Compared to What Was Typical. 
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Figure 15.5 (continued) 

Specific Country/Topic Durations Compared to What Was Typical. 
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Figure 16.1 

Focus Differences from the Majority. 
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Figure 16.1 (continued) 

Focus Differences from the Majority. 
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Figure 16.1 (continued) 

Focus Differences from the Majority. 
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Figure 16.4 

Coverage of Commonly Intended Topics Over Time. 

The cross section of commonly intended topics at the upper grade of Population 2 is here supplemented by the 
curricular flow data to show whether a topic was widely covered in guides and/or textbooks, was intended to be 
covered before, or was intended to be covered later. This figure presents data for all countries for a sample of 
topics. 
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4 
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Figure 16.4 (continued) 

Coverage of Commonly Intended Topics Over Time. 
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Figure 18.1 

Variation in Textbook Use of Performance Expectations - Popnlation 1. 

The textbook block percentages for vanous performance expectations are shown for the upper grade of 
Population 1 The data are for all expectations for all countries The data again show considerable variation. 
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Figure 18.1 (continued) 

Variation ofTextbook Use ofPerformance Expectations - Popnlation 1. 
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Figure 18.1 (continued) 

Variation of Textbook Use of Performance Expectations - Popnlation 1. 



Investigating the Natural Woriil (ouenitating 

Identifying Designing Conducting Interpreting Formulating Accessing t Sharing 
Questions to Investigations Investigations Doto Conclusions Processing tafometio* 
Investigote From Data Uormetlon 



Argentina 




1 


Australia 


I TD 


[ 


Austria 




H 


Belgium (FI)' 


■ T' 


■ 


Belgium (Fr)' 


1 1 


I 


Bulgaria 


1 1 


1 


Canada 


1 1 


[ZD 


China, People's Republic of 


1 1 


r~ 

□ 


Colombia 


Q-j 


Cyprus 


I..ZJ 




Czech Republic 


1 — 1 


1 i 


Denmark 


1 " 


L J 


Dominican Republic 


B~~ 1 


1 


France 


CZl 


1 1 


Greece 


r I 


! 1 




Hong Kong 

Hungary 

Iceland 

Iran 

Ireland’ 

















276 



MANY VISIONS, MANY AIMS 



Figure 18.2 

Variation in Textbook Use of Performance Expectations - Popnlation 2. 

The textbook block percentages for various performance expectations are shown for the upper grade of 
Population 2. Similar variations as with Population 1 persisted at this level. 
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Figure 18.2 (continued) 

Variation of Textbook Use of Performance Expectation - Popnlation 2. 
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Figure 18.2 (continued) 

Variation ofTextbook Use ofPerformance Expectations - Popnlation 2. 
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Table 18.2 

Variations in Performance Expectations. 

The presence or absence of each performance expectation is indicated for the upper grades of Populations 1 and 
2. These data are based only on curriculum guides. The data show that although common expectations existed 
across countries, they did so in a context of strong cross-national variations. 
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Singapore 


1/2 


1/2 


1/2 


1/2 


1/2 


Slovak Republic 


1/2 


1/2 


2 


_ 


_ 


Slovenia 


1/2 


1/2 


1/2 


1/2 


1/2 


South Africa 


2 


2 


1/2 


2 


1/2 


Spain 


1/2 


1 


1 


1/2 


1/2 


Sweden^ 


1/2 


1/2 


1/2 


1/2 


1/2 


Switzerland 


1/2 


1/2 


1/2 


1/2 


1/2 


USA 


1/2 


1/2 


1/2 


1/2 


1/2 



1 Only Population 2 curriculum guides were submitted. 

2 Refer to footnotes in figure 4.t. 

Missing Data: Argentina, Bulgaria, People's Republic of China, Cyprus, Iran, Italy, Lithuania, Thailand, and Tunisia 
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Table 18.2 (continued) 

Variations in Performance Expectations. 



Performance Expectation 



Country 


Abstracting 
& Deducing 
Scientific 
Principles 


Theorizing, Analyzing, & Problems 
Applying Scientific Principles... Constructing, 
... to Solve ... to Develop Interpreting, 

Quantitative Explanations & Applying 

Problems Models 


Making 

Decisions 


Australia 


1/2 


1/2 


1/2 


1/2 


1/2 


Austria 


- 


2 


2 


1/2 


- 


Belgium (FI) 


2 


2 


2 


2 


2 


Belgium (Fr) 


1/2 


1/2 


1/2 


1/2 


1/2 


Canada 


1/2 


1/2 


1/2 


1/2 


1/2 


Colombia 


2 


_ 


1/2 


1/2 


1/2 


Czech Republic 


1 


2 


1/2 


- 


- 


Denmark' 


2 


2 


2 


2 


2 


Dominican Republic 


- 


. 


- 


- 


- 


France 


2 


1/2 


2 


1/2 


2 


Germany 




. 


, 


_ 




Greece 


1 


1/2 


1 


1 


1 


Hong Kong 


2 


1/2 


2 


2 


1/2 


Hungary 


1/2 


2 


2 


2 


2 


Iceland 


1/2 


- 


1/2 


1/2 


1/2 


Ireland 


2 


2 


2 


2 


2 


Israel 


1/2 


1/2 


1/2 


1/2 


1 


Japan 


2 


2 


2 


2 


2 


Korea 


1/2 


1/2 


1/2 


1/2 


1/2 


Latvia 


2 


2 


2 


2 


2 


Mexico 


2 


2 


. 


2 


. 


Netherlands 


. 


2 


1/2 


2 


2 


New Zealand^ 


1/2 


1/2 


1/2 


1/2 


1/2 


Norway 


1/2 




. 


2 


1/2 


Philippines' 


2 


2 


2 


2 


2 


Portugal 


1/2 


1/2 


1/2 


1/2 


1/2 


Romania 


_ 


. 


_ 


2 


. 


Russian Federation 


2 


2 


2 


2 


2 


Scotland 


1/2 


1/2 


1/2 


1/2 


1/2 


Singapore 


1/2 


1/2 


1/2 


1/2 


1/2 


Slovak Republic 


1 


2 


1/2 






Slovenia 


1/2 


1/2 


1/2 


1/2 


1/2 


South Africa 


1/2 


2 


1/2 


1/2 


2 


Spain 




, 


. 


1/2 


_ 


Sweden^ 


- 


- 


- 


• 


- 


Switzerland 


1/2 


2 


1/2 


2 


1/2 


USA 


1/2 


1/2 


1/2 


1/2 


1/2 



I Legend: ] - Present in the curriculum guide for the upper grade of Population 1 

2 ■ Present in the curriculum guide for the upper grode of Populotion 2 
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Table 18.2 (continued) 

Variations in Performance Expectations. 



Using Tools, Routine Procedures, & Science Processes 



Country 


Using 
Apparatus, 
Equipment, 
& Computers 


Conductiug 

Routine 

Experimental 

Operations 


Gathering 

Data 


Organizing & 
Representing 
Data 


Interpreting 

Data 


Australia 


1/2 


1/2 


1/2 


1/2 


1/2 


Austria 


1/2 


1/2 


1/2 


1/2 


1/2 


Belgium (FI) 


1/2 


1/2 


1/2 


1/2 


1/2 


Belgium (Fr) 


1/2 


1/2 


1/2 


1/2 


1/2 


Canada 


1/2 


1/2 


1/2 


1/2 


1/2 


Colombia 


1/2 


1/2 


1/2 


1 


1 


Czech Republic 


2 


2 


1/2 


- 


- 


Denmark' 


2 


2 


2 


2 


■ 


Dominican Republic 


- 


- 


- 


- 


- 


France 


1/2 


1/2 


1/2 


1/2 


1/2 


Germany 


- 


- 


- 


- 


- 


Greece 


1 


1/2 


1 


1 


1 


Hong Kong 


1/2 


1/2 


1/2 


1 


2 


Hungary 


1/2 


1/2 


1/2 


2 


1/2 


Iceland 


1/2 


1/2 


1/2 


- 


1/2 


Ireland 


1/2 


1/2 


1/2 


1/2 


1/2 


Israel 


1/2 


1/2 


1/2 


1/2 


1/2 


Japan 


2 


2 


2 


2 


2 


Korea 


1/2 


1/2 


2 


2 


2 


Latvia 


2 


1/2 


1/2 


2 


1/2 


Mexico 


1 


1/2 


1/2 


1/2 


1/2 


Netherlands 


1/2 


1/2 


2 


2 


2 


New Zealand^ 


1/2 


1/2 


1/2 


1/2 


1/2 


Norway 


1/2 


1/2 


1/2 


1/2 


1/2 


Philippines' 


2 


2 


2 


2 


2 


Portugal 


1/2 


1/2 


1/2 


1/2 


1/2 


Romania 


2 


2 


2 


- 


- 


Russian Federation 


1/2 


1/2 


1/2 


1/2 


1/2 


Scotland 


1/2 


1/2 


1/2 


1/2 


1/2 


Singapore 


1/2 


1/2 


1/2 


1/2 


1/2 


Slovak Republic 


2 


2 


1/2 


2 


2 


Slovenia 


1/2 


1/2 


1/2 


1/2 


1/2 


South Africa 


1/2 


2 


1/2 


1/2 


2 


Spain 


1/2 


1/2 


1/2 


1/2 


1/2 


Sweden^ 


1/2 


1/2 


1/2 


- 


- 


Switzerland 


1/2 


1/2 


1/2 


1/2 


2 


USA 


1/2 


1/2 


1/2 


1/2 


1/2 



1 Only Population 2 curriculum guides were submitted. 

2 Refer to footnotes in figure 4.1. 

Missing Data: Argentina, Bulgaria, People's Republic of China, Cyprus, Iran, Italy, Lithuania, Thailand, and Tunisia 
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Table 18.2 (continued) 

Variations in Performance Expectations. 



Performance Expectation 
Investigating the Natural World 





Identifying 


Designing 


Conducting 


Interpreting 


Formulating 




Questions to 
Investigate 


Investigations 


Investigations 


Investigational 

Data 


Conclusions 

From 

Investigational 

Data 


Australia 


1/2 


1/2 


1/2 


1/2 


1/2 


Austria 


1/2 


1/2 


1/2 


1/2 


1/2 


Belgium (FI) 


1/2 


1/2 


1/2 


1/2 


1/2 


Belgium (Fr) 


1/2 


1/2 


1/2 


1/2 


1/2 


Canada 


1/2 


1/2 


1/2 


1/2 


1/2 


Colombia 


2 


. 


, 




. 


Czech Republic 


- 


- 


1/2 


- 


- 


Denmark' 


2 


2 


2 


2 


2 


Dominican Republic 


- 


- 


- 


- 


- 


France 


1/2 


1/2 


1/2 


1/2 


1/2 


Germany 


. 


. 


. 


. 


. 


Greece 


1 


1 


1 


1 


1 


Hong Kong 


- 


2 


1/2 


2 


2 


Hungary 


1/2 


2 


2 


1/2 


2 


Iceland 


1/2 


1/2 


1/2 


1/2 


1/2 


Ireland 


1/2 


1/2 


1/2 


1/2 


1/2 


Israel 


1 


1 


1/2 


1/2 


1/2 


Japan 


1/2 


2 


2 


2 


2 


Korea 


. 


- 


1 


1 


. 


Latvia 


2 


1/2 


1/2 


1/2 


1/2 


Mexico 


2 


_ 


_ 


1/2 


. 


Netherlands 


1/2 


1/2 


1/2 


1/2 


1/2 




1/2 


1/2 


1/2 


1/2 


1/2 


Norway 


1/2 


1/2 


1/2 


1/2 


1/2 


Philippines' 


■ 


- 


- 


- 


- 


Portugal 


1/2 


1/2 


1/2 


1/2 


1/2 


Romania 


. 


_ 


2 


. 


. 


Russian Federation 


2 


2 


2 


2 


2 


Scotland 


1/2 


1/2 


1/2 


1/2 


1/2 


Singapore 


1/2 


1/2 


1/2 


1/2 


1/2 


Slovak Republic 




. 


1/2 


_ 


_ 


Slovenia 


1/2 


1/2 


1/2 


1/2 


1/2 


South Afnca 


2 


2 


1/2 


1/2 


1/2 


Spain 


. 


1 


1 


1 


- 


Sweden^ 


1/2 


1/2 


1/2 


1/2 


1/2 


Switzerland 


1/2 


1/2 


1/2 


1/2 


1/2 


USA 


1/2 


1/2 


1/2 


1/2 


1/2 



1 Only Population 2 curriculum guides were submitted. 

2 Refer to footnotes in figure 4.1. 

Missing Data: Argentina, Bulgaria, People's Republic of China, Cyprus, Iran, Italy, Lithuonia, Thoilond, and Tunisia 



I Legend: ] - Present in the curriculum guide for the upper grade of Population 1 

2 - Present in the curriculum guide for the upper grade of Population 2 
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Figure 18.6 

Variation in Textbook Use of Performance Expectations - Physics Specialists. 

The textbook block percentages for various performance expectations are shown for books used by the physics specialists of Population 3. 
The data are shown for all performance expectations. A general emphasis on understanding simple and complex information was seen in 
many countries, as well as considerable emphasis on solving quantitative problems. 
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Figure 18.6 (continued) 

Variation in Textbook Use of Performance Expectations - Physics Specialists. 
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Figure 18. 6 (continued) 

Variation in Textbook Use of Performance Expectations - Physics Specialists. 
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Appendix J 

List of Tables: Science 

Table 3.1: Differences in National Education Systems. This table presents information on 
which grades were clustered together, on the numbers of years of compulsory education and 
years of education offered, and on school entry ages in various countries. Cross-national 
differences are clear. 

Table 3.2: Organizational Differences in Five Typical Countries. This display of how grades 
were grouped in phases of schooling in five countries clearly illustrates the strong organi- 
zational differences among countries. Indicating key grades for TIMSS achievement test- 
ing makes it clear that these differences have implications for testing. 

Table 3.3: Summary of Science Reform Interests in a Representative Set of Countries. Wide- 
spread interest was expressed in science education reforms. This table summarizes reform 
interests in a representative sample of TIMSS countries as provided by experts within each 
country. 

Table 4.1: Specificity of Curriculum Guides. These are the percentages for the guides of the 
upper grades of Populations 1 and 2 in a representative sample of countries showing 
whether content codes and performance expectation codes were assigned at very specific or 
more general levels of the TIMSS framework. Content, and to a somewhat lesser degree 
performance expectations, were generally given at specific levels. 

Table 5.1: Introducing, Focusing On, and Completing Science Topics. There were important 
differences in the grade at which different science topics were introduced. There were also 
differences in the typical grade for completing topics and for focusing special attention on 
them. 

Table 5.2: Science Topics Intended for Introduction in Various Stages. Certain framework top- 
ics were typically introduced at various stages of schooling: grades 1 to 3, 4 to 6, 7 to 8, 9 
to 12. This table presents a broad picture of the typical sequence of science topics intro- 
duction (representing the aggregate and not individual countries). 
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Table 6.1 : Commonly Intended Seienee Topies. Here are lists of the most eommonly intended 
(at least 70 pereent of eountries) seienee topies at the upper grades of Populations 1 and 2 
based on an analysis of eurrieulum guides and textbooks. Some topies were eommon only 
in eurrieulum guides, others only in textbooks, and still others in both. A few were not only 
ineluded but were also emphasized in textbooks. 

Table 6.2: Commonly Intended Topies for Physies Speeialists. Here are the common topics for 
physics specialists at the end of secondary school. These topics were in the curriculum 
guides and/or textbooks of at least 70 percent of the countries; those indicated with an aster- 
isk were also emphasized in textbooks. 

Table 7.1: Topics Present in Both Curriculum Guides and Textbooks. Topics present in both 
the curriculum guides and textbooks for a given grade level in a country probably received 
more emphasis than those not present in both. The data for all topics and all countries are 
shown here for the upper grade of Population 2. Few topics received unanimous emphasis 
in all countries, but many were widely emphasized. 

Table 8.1: Commonly Intended Performance Expectations. Performance expectations indicat- 

ed in the curriculum guides of 70 percent ofTIMSS countries, 70 percent of countries’ text- 
books, or both are shown here. Those emphasized in textbooks (accounting for 6 percent 
or more of textbook blocks) are marked with an asterisk. These data are only for upper 
grades of Populations 1 and 2. 

Table 8.2: Variations in Performance Expectations. The presence or absence of each perfor- 
mance expectation is indicated for the upper grades of Populations 1 and 2. These data are 
based only on curriculum guides. The data show that although common expectations exist- 
ed across countries, they did so in a context of strong cross-national variations. 

Table 8.3: Commonly Intended Performance Expectations - Physics Specialists. The perfor- 
mance expectations indicated in the curriculum guides of 70 percent of the TIMSS countries, 
70 percent of countries’ textbooks, or both are shown here. Expectations emphasized in text- 
books (that is, accounting for 6 percent or more of textbook blocks) are marked with an aster- 
isk. These data are only for materials related to the Physics specialists of Population 3. 

Table 8.4: Variations in Perspectives. The presence or absence of each perspective is indicat- 
ed for the upper grades of Populations 1 and 2. These data are based on curriculum guides. 
Use of perspectives was common in many of these documents. 

Table 9.1: Topic Coverage in Eight Regions - Population 1. These data are the average per- 
centage of textbook blocks for each science topic averaged over the countries in one of eight 
regions. They are only for the upper grade of Population 1. Notable variations among 
regions occur in the areas of ‘energy and physical processes,’ ‘diversity, organization, struc- 
ture of living things,’ and ‘earth features.’ 
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Table 9.2: Topic Coverage in Eight Regions — Population 2. These data are similar to those 
in the previous table but are only for the upper grade of Population 2. In addition to region- 
al variations on some of the same topic areas as noted for Population 1 in Table 9.1, a vari- 
ety of earth, life, and physical science topics present noteworthy regional variation. 

Table 9.3: Topic Coverage for Four National Income Groups — Population 1. These data are 
the average percentages of textbook blocks for each science topic averaged over the coun- 
tries in four national income groups (determined by World Bank criteria and data). They 
are for the upper grade of Population 1 only. 

Table 9.4: Topic Coverage for Four National Income Groups — Population 2. These data are 
similar to those for the previous table, but are only for the upper grade of Population 2. 

Table 9.5: Topic Coverage for Eight Statistically Determined Clusters — Population 1. These 
data are the average percentages of textbook blocks for each science topic area averaged for 
each of eight statistically determined clusters of countries. Several strong differences were 
seen. 

Table 9.6: Topic Coverage for Eight Statistically Determined Clusters — Population 2. These 
data are the average percentages of textbook blocks for each science topic averaged for 
eight statistically determined clusters of countries. The data are only for the upper grade of 
Population 2. 

Table E. 1: Unit Types in Curriculum Guides and Textbooks. Percentages of each unit type for 
the documents sampled are shown for all populations and for both guides and textbooks. 
Curriculum guides were dominated by objective and content units. Eesson units clearly 
dominated textbooks. 

Table E.2: Distribution of Block Types. Here are the percentages of block types for the pool 
of sampled curriculum guides and textbooks. Curriculum guides were mainly composed of 
objective, content, and pedagogical suggestion blocks. Textbooks mainly contained related 
graphic and narrative blocks. Activities played a larger role for younger populations: exer- 
cise sets played a larger role for older populations. 

Table E.3: Proportions of Single and Multiple Content Codes. The average number of content 
codes assigned to a block is given for each type of document and population. The percent- 
ages of single and multiple codes among all those assigned to blocks are also given. 
Clearly, single and double codes predominated. 

Table E.4: Proportion of Single and Multiple Performance Expectation Codes. The average 
number of performance expectation codes assigned to a block is given for each type of doc- 
ument and population. The percentages of single and multiple codes are also given. 




290 



MANY VISIONS, MANY AIMS 



Table 13.3: Summary of Science Reform Interests in TIMSS Countries. Widespread interest 
was expressed in science education reforms. Here is a summary of reform interests in 
TIMSS countries as reported by experts within each country. 

Table 14.1: Specificity of Curriculum Guides. These are the percentages for the guides of the 

upper grades of Populations 1 and 2 showing whether content codes and performance 
expectation codes were assigned at specific or more general levels of the TIMSS frame- 
work. Content codes, and, to a somewhat lesser degree, performance expectations codes 
were generally given at specific levels. 

Table 18.2: Variations in Performance Expectations. The presence or absence of each perfor- 
mance expectation is indicated for the upper grades of Populations 1 and 2. These data are 
based only on curriculum guides. The data show that although common expectations exist- 
ed across countries, they did so in a context of strong cross-national variations. 
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Appendix K 

List of Figures: Science 

Figure 3.1: Distribution of Block Types in Science Textbooks. The percentages of selected 
block types are given for science textbooks for the upper grade of Population 2. The text- 
books certainly differed in what they presented and, consequently, how they might be used. 

Figure 3.2: Textbook Space Devoted to Major Science Topics. This figure shows the percent- 
ages of textbook blocks devoted to the eight broadest science framework content categories 
for the textbooks of the upper grade of Population 2 in a representative selection of coun- 
tries. This shows patterns of varying emphasis that held true for other countries and grades 

Figure 3.3: Textbook Space Devoted to Major Performance Expectations for Selected 

Countries. These data are similar to those in figure 3.2, but for the broadest performance 
expectation categories. They also reveal considerable variation. 

Figure 3.4: Comparative Sequences in Four Science Topics for the People’s Republic of China 
and Iceland. Focusing only on two countries and four topics shows that the sequence of 
covering aspects of topics varied as well as did overall emphasis. 

Figure 4.1: Proportions of Different Units in Population 1. The figure shows the percentage of 

pages in science curriculum guides for the upper grade of Population 1 for each unit type. 
Some countries were more prescriptive-that is, had higher percentages of policy, objective, 
and content units. Others were relatively more facilitative - that is, had comparatively high- 
er percentages of pedagogy units. 

Figure 4.2: Proportions of Different Block Types in Population 2. This figure presents science 
curriculum guide block type percentages. 

Figure 4.3: Pedagogical Blocks within Pedagogy Units. These are the percentages of the three 
types of pedagogy blocks within the pool of blocks from pedagogy units for a representa- 
tive sample of countries and science guides for the upper grade of Population 2. The struc- 
ture of pedagogy units were varied in many countries. 

Figure 5.1: Number of Topics Introduced Very Early or Very Eate. Some countries introduced 
many topics far earlier than was typical and some topics far later. 
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Figure 5.2: The Eight Topics Whose Introductory Grade Varied Most. Many topics varied con- 
siderably among countries in terms of the grade in which they were introduced. These eight 
topics varied the most. 

Figure 5.3: Average Number of Grades Intended Across Topics by Countries. Some countries 
had an average duration across topics that was far less than the median for all countries. 
Others had an average topic duration far greater than the median. 

Figure 5.4: Average Number of Grades Intended for Each Topic. More time was spent on some 
topics (longer average duration) than others, as these averages across all countries show. 
Other topics were covered for shorter times on average. 

Figure 5.5: Specific Country/Topic Durations Compared to What Was Typical. Statistical 

methods were used to produce numbers indicating how many fewer (gray-shaded icons) or 
more (black-shaded icons) grades the duration for a specific country and topic was from the 
duration for a typical country and topic — that is, a double difference. Considerable diver- 
sity is shown. 

Figure 5.6: Number of Topics To Be Covered for Each Grade in Each Country. The number of 
topics to be covered in various grades differs considerably across countries. 

Figure 5.7: Number of Topics Introduced and Dropped. Countries differed in terms of how 
many topics were introduced and how many were dropped at each grade. These data show 
how the number of topics covered in each grade were accumulated. 

Figure 6.1: Focus Differences from the Majority for Selected Countries. For most topics there 
was one grade by which a majority of countries had focused on the topic. Individual coun- 
tries had foci that differed from the majority for at least some topics. A few countries were 
selected to illustrate the differences in which focus differed from the majority. Negative 
numbers (gray-shaded icons) indicate focus earlier than was typical. Some differences were 
large enough to indicate quite different approaches to the topics involved. 

Figure 6.2: Proportions of Countries Covering Each Topic at Each Grade. The actual percent- 
ages of countries covering each topic at each grade were used to identify a coverage level 
indicated by one of the four symbols. The display makes it easier to identify topics and 
grades for which there were strong similarities in content coverage. 

Figure 6.3: Proportions of Countries Focusing on Each Topic at Each Grade. The same sys- 
tem as in the previous figure is used to portray topics and grades at which curricular atten- 
tion was commonly focused. Far fewer common foci are seen than topics and grades with 
high common coverage. 
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Figure 6.4: Coverage of Commonly Intended Topics Over Time. The cross-section of com- 
monly intended topics at the upper grade of Population 2 is here supplemented by the cur- 
ricular flow data to show whether a topic was widely covered in guides and/or textbooks, 
was intended to be covered before, or was intended to be covered later. This figure presents 
data for a sample of countries and topics. 

Figure 7.1 : Curricular Attention - Population 1. The share of curricular attention for each topic 
within each grade and country was computed. The index of comparative attention is pre- 
sented by one of the five symbols. They are for the upper grade of Population 1 for some 
widely intended topics in that grade and for all countries. This illustrates the variation typ- 
ical of the data for all topics. 

Figure 7.2: Variations in Textbook Space for Two Commonly Intended Topics - Population I. 
The percentage of textbook blocks devoted to the two emphasized and widely covered top- 
ics at the upper grade for Population 1 is shown for each country. The variation in attention 
to these topics is obvious. 

Figure 7.3: Variations in Textbook Space for ‘Organs and Tissues’ - Population 2. The life sci- 
ence topic of ‘organs and tissues’ is the single topic widely covered and emphasized in text- 
books at the upper grade of Population 2. Here the percentage of textbook blocks devoted 
to this topic is shown for all countries providing data. Five countries devoted more than fif- 
teen percent of textbook blocks to this topic; eight devoted fewer than five percent. 

Figure 7.4: Variations in Textbook Space for Six Core Topics - Physics Specialists. Six topics 
- five of them in the area of energy and physical processes, one in the area of forces and 
motion - were widely covered and emphasized for the Physics Specialists of Population 3. 
The textbook block percentages for these four topics presented here show the extensive 
variation even in comparatively focused textbooks. 

Figure 8.1 : Variation of Textbook Use of Performance Expectations - Population 1. The text- 
book block percentages for various performance expectations are shown for the upper grade 
of Population 1 . The data are for all expectations for a sample of countries. The data again 
show considerable variation. 

Figure 8.2: Variation of Textbook Use of Performance Expectations - Population 2. The text- 
book block percentages for various performance expectations are shown for the upper grade 
of Population 2. Similar variations as with Population 1 persisted at this level. 

Figure 8.3: Performance Expectations for ‘Plants, Fungi.’ The percentages of performance 
expectations in textbook blocks dealing with ‘plants, fungi’ are presented for the upper 
grade of Population 1. In almost all countries ‘understanding simple information’ account- 
ed for close to 40 percent or more of textbook blocks. 




294 



MANY VISIONS, MANY AIMS 



Figure 8.4: Performance Expectations for ‘Animals.’ Data similar to those for the previous fig- 
ure are presented for the next most common topic for the upper grade of Population 1. 
Again, considerable emphasis was placed on ‘understanding simple information’. 

Figure 8.5: Performance Expectations for ‘Organs, Tissues.’ Data similar to those in Figure 8.3 
are presented on the most common topic for the upper grade of Population 2. Again, greater 
emphasis is shown on ‘understanding simple information,’ although there is considerable 
more emphasis in ‘understanding complex information’ than had been the case with the 
most commonly covered topics for the upper grade of Population 1. 

Figure 8.6: Variations in Textbook Use of Performance Expectations - Physics Specialists. The 
textbook block percentages for various performance expectations are shown for books used 
by the physics specialists of Population 3. The data are shown for all performance expec- 
tations but for a representative selection of countries. A general emphasis on understanding 
simple and complex information was seen in many countries as well as considerable empha- 
sis on solving quantitative problems. 

Figure 8.7: Variations of Textbook Use of Perspectives - Population 1. The textbook block per- 
centages for various perspectives are shown for the upper grade of Population 1 . The data 
for all perspectives, and for all countries, are shown. A small number of countries made 
considerable use of perspectives. 

Figure 8.8: Variations in Textbook Use of Perspectives - Population 2. Data similar to those in 
the previous table are shown but for the upper grade of Population 2. 

Figure A. 1 : Textbooks — The Potentially Implementable Curriculum. Textbooks served as 
intermediaries in turning intentions into implementations. They helped make possible one 
or more potential implementations of science curricular intentions. 

Figure B. 1 : The TIMSS Model of Potential Educational Experiences. The means by which cur- 
ricular aims and choices affect what happens in classrooms, and what students attain is part 
of an intricate system that includes many factors. 

Figure C. 1 : Content Categories of the Science Framework. Each aspect of the framework con- 
tained a set of main categories. Each main category contained one or more levels of more 
specific sub-categories. The main content categories are shown here with some sub-cate- 
gories expanded to give a better insight into the framework’s structure. 

Figure D. I : Two Representative Topic Trace Maps: These data are typical topic trace maps for 
a sample of countries selected to show representative diversity among maps produced by 
topic trace mapping. The results are typical of those for other topics and countries. 
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Figure E. 1: Two Sample Textbook Pages. Here are two sample pages from a Colombian sci- 
ence textbook for the upper grade of Population 2. They represent part of one unit. Their 
division into blocks and the numbers for each of block and unit were indicated by the 
Colombian National Document Analysis Team. 

Figure E.2: Sample Block Coding Form. This is the completed coding form that includes the 
blocks from the earlier sample text pages (Figure E. 1). It records a block’s page number (in 
the text), identification number, type, and codes for appropriate framework categories. 

Figure 13.2 Textbook Space Devoted to Major Science Topics. This figure shows the percent- 
ages of textbook blocks devoted to the eight broadest science framework content categories 
for the textbooks of the upper grade of Population 2 in all countries. 

Figure 15.5 Specific Country/Topic Durations Compared to What Was Typical. Statistical 
methods were used to produce numbers indicating how many fewer (gray-shaded icons) or 
more (black-shaded icons) grades the duration for a specific country and topic was from the 
duration for a typical country and topic — that is, a double difference. Considerable diver- 
sity is shown. 

Figure 16.1 Focus Differences from the Majority. For most topics there was one grade by 
which a majority of countries had focused on the topic. Individual countries had foci that 
differed from the majority for at least some topics. Negative numbers (gray-shaded icons) 
indicate focus earlier than was typical. Some differences were large enough to indicate 
quite different approaches to the topics involved. 

Figure 16.4 Coverage of Commonly Intended Topics Over Time. The cross section of com- 
monly intended topics at the upper grade of Population 2 is here supplemented by the cur- 
ricular flow data to show whether a topic was widely covered in guides and/or textbooks, 
was intended to be covered before, or was intended to be covered later. This figure presents 
data for all countries for a sample of topics. 

Figure 18.1 Variation in Textbook Use of Performance Expectations - Population 1. The text- 
book block percentages for various performance expectations are shown for the upper grade 
of Population 1. The data are for all expectations for all countries. The data again show con- 
siderable variation. 

Figure 18.2 Variation in Textbook Use of Performance Expectations - Population 2. The text- 
book block percentages for various performance expectations are shown for the upper grade 
of Population 2. Similar variations as with Population 1 persisted at this level. 

Figure 18.6 Variation in Textbook Use of Performance Expectations - Physics Specialists. The 
textbook block percentages for various performance expectations are shown for books used 
by the physics specialists of Population 3. The data are shown for all performance expecta- 
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tions. A general emphasis on understanding simple and complex information was seen in 
many countries, as well as considerable emphasis on solving quantitative problems. 




